Apr 14 13:05:59 user devstack@n-api.service[61773]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 13:05:59 user devstack@n-api.service[61773]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 13:05:59 2023] *** Apr 14 13:05:59 user devstack@n-api.service[61773]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 13:05:59 user devstack@n-api.service[61773]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 13:05:59 user devstack@n-api.service[61773]: nodename: user Apr 14 13:05:59 user devstack@n-api.service[61773]: machine: x86_64 Apr 14 13:05:59 user devstack@n-api.service[61773]: clock source: unix Apr 14 13:05:59 user devstack@n-api.service[61773]: pcre jit disabled Apr 14 13:05:59 user devstack@n-api.service[61773]: detected number of CPU cores: 12 Apr 14 13:05:59 user devstack@n-api.service[61773]: current working directory: / Apr 14 13:05:59 user devstack@n-api.service[61773]: detected binary path: /usr/bin/uwsgi-core Apr 14 13:05:59 user devstack@n-api.service[61773]: your processes number limit is 63637 Apr 14 13:05:59 user devstack@n-api.service[61773]: your memory page size is 4096 bytes Apr 14 13:05:59 user devstack@n-api.service[61773]: detected max file descriptor number: 2048 Apr 14 13:05:59 user devstack@n-api.service[61773]: lock engine: pthread robust mutexes Apr 14 13:05:59 user devstack@n-api.service[61773]: thunder lock: enabled Apr 14 13:05:59 user devstack@n-api.service[61773]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 13:05:59 user devstack@n-api.service[61773]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 13:05:59 user devstack@n-api.service[61773]: Python main interpreter initialized at 0x561dbd9bf990 Apr 14 13:05:59 user devstack@n-api.service[61773]: python threads support enabled Apr 14 13:05:59 user devstack@n-api.service[61773]: your server socket listen backlog is limited to 100 connections Apr 14 13:05:59 user devstack@n-api.service[61773]: your mercy for graceful operations on workers is 90 seconds Apr 14 13:05:59 user devstack@n-api.service[61773]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 13:05:59 user devstack@n-api.service[61773]: *** Operational MODE: preforking *** Apr 14 13:05:59 user devstack@n-api.service[61773]: *** uWSGI is running in multiple interpreter mode *** Apr 14 13:05:59 user devstack@n-api.service[61773]: spawned uWSGI master process (pid: 61773) Apr 14 13:05:59 user devstack@n-api.service[61773]: spawned uWSGI worker 1 (pid: 61774, cores: 1) Apr 14 13:05:59 user devstack@n-api.service[61773]: spawned uWSGI worker 2 (pid: 61775, cores: 1) Apr 14 13:05:59 user devstack@n-api.service[61773]: spawned uWSGI worker 3 (pid: 61776, cores: 1) Apr 14 13:05:59 user devstack@n-api.service[61773]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 13:05:59 user devstack@n-api.service[61776]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 13:05:59 user devstack@n-api.service[61775]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 13:05:59 user devstack@n-api.service[61774]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 13:06:03 user devstack@n-api.service[61776]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 13:06:03 user devstack@n-api.service[61776]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 13:06:03 user devstack@n-api.service[61776]: and ``live_migration_inbound_addr`` respectively. Apr 14 13:06:03 user devstack@n-api.service[61776]: ). Its value may be silently ignored in the future. Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 13:06:03 user devstack@n-api.service[61774]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 13:06:03 user devstack@n-api.service[61774]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 13:06:03 user devstack@n-api.service[61774]: and ``live_migration_inbound_addr`` respectively. Apr 14 13:06:03 user devstack@n-api.service[61774]: ). Its value may be silently ignored in the future. Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 13:06:03 user devstack@n-api.service[61775]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 13:06:03 user devstack@n-api.service[61775]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 13:06:03 user devstack@n-api.service[61775]: and ``live_migration_inbound_addr`` respectively. Apr 14 13:06:03 user devstack@n-api.service[61775]: ). Its value may be silently ignored in the future. Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61776) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61774) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61776]: INFO dbcounter [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Registered counter for database nova_api Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61775) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_db.sqlalchemy.engines [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61776) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61774]: INFO dbcounter [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Registered counter for database nova_api Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writer thread running {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_db.sqlalchemy.engines [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61774) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writer thread running {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG nova.context [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),45b69ebb-541a-4e02-b5a2-fe8b4d873612(cell1) {{(pid=61776) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:06:03 user devstack@n-api.service[61776]: INFO dbcounter [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Registered counter for database nova_cell0 Apr 14 13:06:03 user devstack@n-api.service[61776]: INFO dbcounter [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Registered counter for database nova_cell1 Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_db.sqlalchemy.engines [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61776) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_db.sqlalchemy.engines [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61776) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writer thread running {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writer thread running {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG nova.context [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),45b69ebb-541a-4e02-b5a2-fe8b4d873612(cell1) {{(pid=61774) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 13:06:03 user devstack@n-api.service[61775]: INFO dbcounter [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Registered counter for database nova_api Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:06:03 user devstack@n-api.service[61774]: INFO dbcounter [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Registered counter for database nova_cell0 Apr 14 13:06:03 user devstack@n-api.service[61774]: INFO dbcounter [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Registered counter for database nova_cell1 Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_db.sqlalchemy.engines [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61774) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writer thread running {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_db.sqlalchemy.engines [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61774) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_db.sqlalchemy.engines [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61775) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writer thread running {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG nova.context [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),45b69ebb-541a-4e02-b5a2-fe8b4d873612(cell1) {{(pid=61775) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:06:03 user devstack@n-api.service[61775]: INFO dbcounter [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Registered counter for database nova_cell0 Apr 14 13:06:03 user devstack@n-api.service[61775]: INFO dbcounter [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Registered counter for database nova_cell1 Apr 14 13:06:03 user devstack@n-api.service[61776]: INFO dbcounter [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Registered counter for database nova_cell0 Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_db.sqlalchemy.engines [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61775) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writer thread running {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_db.sqlalchemy.engines [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61775) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG oslo_db.sqlalchemy.engines [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61776) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writer thread running {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writer thread running {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61774]: INFO dbcounter [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Registered counter for database nova_cell0 Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG oslo_db.sqlalchemy.engines [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61774) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writer thread running {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writer thread running {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61775]: INFO dbcounter [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Registered counter for database nova_cell0 Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG oslo_db.sqlalchemy.engines [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61775) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 13:06:03 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writer thread running {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 13:06:03 user devstack@n-api.service[61776]: WARNING keystonemiddleware.auth_token [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 13:06:03 user devstack@n-api.service[61776]: WARNING keystonemiddleware.auth_token [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 13:06:04 user devstack@n-api.service[61774]: WARNING keystonemiddleware.auth_token [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 13:06:04 user devstack@n-api.service[61774]: WARNING keystonemiddleware.auth_token [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 13:06:04 user devstack@n-api.service[61776]: WARNING keystonemiddleware.auth_token [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 13:06:04 user devstack@n-api.service[61776]: WARNING keystonemiddleware.auth_token [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 13:06:04 user devstack@n-api.service[61776]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561dbd9bf990 pid: 61776 (default app) Apr 14 13:06:04 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:06:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001569 Apr 14 13:06:04 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 13:06:04 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:06:04 user devstack@n-api.service[61775]: WARNING keystonemiddleware.auth_token [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 13:06:04 user devstack@n-api.service[61775]: WARNING keystonemiddleware.auth_token [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 13:06:04 user devstack@n-api.service[61774]: WARNING keystonemiddleware.auth_token [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 13:06:04 user devstack@n-api.service[61774]: WARNING keystonemiddleware.auth_token [None req-92b24623-3b6e-47ae-bd6e-49b4321c54d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 13:06:04 user devstack@n-api.service[61774]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561dbd9bf990 pid: 61774 (default app) Apr 14 13:06:04 user devstack@n-api.service[61775]: WARNING keystonemiddleware.auth_token [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 13:06:04 user devstack@n-api.service[61775]: WARNING keystonemiddleware.auth_token [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 13:06:04 user devstack@n-api.service[61775]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561dbd9bf990 pid: 61775 (default app) Apr 14 13:08:13 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-18819fea-a6c6-411f-935b-a6c226019204 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001618 Apr 14 13:08:13 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:13 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:13 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:13 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:13 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:13 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6ecf4680-c9f5-4ed7-98c5-9bfd8a737b4c admin admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:13 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6ecf4680-c9f5-4ed7-98c5-9bfd8a737b4c admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.374550 Apr 14 13:08:13 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 13:08:13 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:15 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002528 Apr 14 13:08:15 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:15 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:15 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=3 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:15 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=3 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:15 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=3 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:15 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:16 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4a03b167-dac6-44f2-ba7f-418c4b3f9a4f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "name": "cirros256"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4a03b167-dac6-44f2-ba7f-418c4b3f9a4f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.328149 Apr 14 13:08:16 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:15 2023] POST /compute/v2.1/flavors => generated 405 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 13:08:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-dc7de696-cd13-416e-a101-a477b58b2284 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:16 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-dc7de696-cd13-416e-a101-a477b58b2284 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043045 Apr 14 13:08:16 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 13:08:16 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001552 Apr 14 13:08:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:18 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c0aa9808-b4d4-4835-9ae0-643a30888286 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "id": "d1", "ram": 512, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c0aa9808-b4d4-4835-9ae0-643a30888286 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062047 Apr 14 13:08:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:18 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-463083cd-7aa2-4251-9212-96f93bda74b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-463083cd-7aa2-4251-9212-96f93bda74b2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026116 Apr 14 13:08:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 13:08:18 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:08:20 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001929 Apr 14 13:08:20 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:20 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-643f490f-3973-42fa-a922-1b6455178e9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-643f490f-3973-42fa-a922-1b6455178e9a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061508 Apr 14 13:08:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:20 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:20 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-25ba298c-a378-45d9-9f53-62678af44ef5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-25ba298c-a378-45d9-9f53-62678af44ef5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026490 Apr 14 13:08:20 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 13:08:20 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:22 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:22 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001429 Apr 14 13:08:22 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:22 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-24b497b8-5e43-46cb-907b-208b20e2b773 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "vcpus": 2, "id": "d3"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:22 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-24b497b8-5e43-46cb-907b-208b20e2b773 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064810 Apr 14 13:08:22 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:22 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:22 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6743374f-3afe-4b4f-b0e9-39fed64b5a61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:22 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6743374f-3afe-4b4f-b0e9-39fed64b5a61 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072168 Apr 14 13:08:22 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 13:08:22 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:24 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001384 Apr 14 13:08:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:24 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:24 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-daa1a44a-0405-4313-b88f-e99639836e3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:24 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-daa1a44a-0405-4313-b88f-e99639836e3c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076959 Apr 14 13:08:24 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:24 2023] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:24 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053803 Apr 14 13:08:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 13:08:24 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:26 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3e6b0334-76ed-4f9f-8b5f-67f982515074 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001442 Apr 14 13:08:26 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:26 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:26 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-3f5ca5e4-4b62-40e5-8e47-a32fc809bce3 admin admin] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-3f5ca5e4-4b62-40e5-8e47-a32fc809bce3 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.078227 Apr 14 13:08:26 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 13:08:26 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:08:28 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002260 Apr 14 13:08:28 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:28 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:28 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:28 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:28 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:28 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:08:28 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0ba476b6-2444-407f-924b-d803762eb6a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "ram": 512, "name": "m1.tiny", "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:28 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0ba476b6-2444-407f-924b-d803762eb6a7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.326328 Apr 14 13:08:28 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:28 2023] POST /compute/v2.1/flavors => generated 400 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2f5dad36-3545-4183-9e88-dbf78a480804 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2f5dad36-3545-4183-9e88-dbf78a480804 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042874 Apr 14 13:08:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 13:08:28 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:30 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:30 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001566 Apr 14 13:08:30 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:30 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-92f03100-9ef8-4574-9a83-7e21c8daea74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-92f03100-9ef8-4574-9a83-7e21c8daea74 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064262 Apr 14 13:08:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:30 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:30 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-11717f33-ed45-4ef1-9f56-0c899ba998aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:30 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-11717f33-ed45-4ef1-9f56-0c899ba998aa admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032108 Apr 14 13:08:30 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 13:08:30 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:32 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:32 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001514 Apr 14 13:08:32 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:32 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-2a68b307-93be-4ccd-89b4-cf142187a415 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-2a68b307-93be-4ccd-89b4-cf142187a415 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076628 Apr 14 13:08:32 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:32 2023] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:32 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ee25d260-84b3-4005-82ba-bda1f7a5e3c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:32 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ee25d260-84b3-4005-82ba-bda1f7a5e3c7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026092 Apr 14 13:08:32 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 13:08:32 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:34 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:34 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002253 Apr 14 13:08:34 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:34 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:35 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7bf15457-de1b-40b4-a04f-0ecedec4a994 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:35 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-7bf15457-de1b-40b4-a04f-0ecedec4a994 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.087124 Apr 14 13:08:35 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:34 2023] POST /compute/v2.1/flavors => generated 403 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:35 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-05c26fca-65dc-4874-83bb-f3f5f7a0614b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:35 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-05c26fca-65dc-4874-83bb-f3f5f7a0614b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054298 Apr 14 13:08:35 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 13:08:35 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:08:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:08:37 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002434 Apr 14 13:08:37 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 13:08:37 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:08:37 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a50805b6-364c-41c4-a66c-054c69be6717 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a50805b6-364c-41c4-a66c-054c69be6717 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.062402 Apr 14 13:08:37 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 13:08:37 2023] POST /compute/v2.1/flavors => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:08:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-0a981efa-bd72-4762-961b-aef79141d513 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:08:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-0a981efa-bd72-4762-961b-aef79141d513 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027085 Apr 14 13:08:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 13:08:37 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:09:07 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:09:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-22bf0358-54d4-47ba-8ef6-421a2a8a99c6 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001535 Apr 14 13:09:07 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 13:09:07 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:09:07 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:09:07 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:09:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:09:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:09:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:09:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:09:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:09:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:09:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.093886 Apr 14 13:09:07 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 13:09:07 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:09:39 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-0a981efa-bd72-4762-961b-aef79141d513 admin admin] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:09:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-0a981efa-bd72-4762-961b-aef79141d513 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001796 Apr 14 13:09:39 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 13:09:39 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:09:39 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:09:39 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e06202cb-e7f7-4270-88d9-9430670d8c36 admin admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:09:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e06202cb-e7f7-4270-88d9-9430670d8c36 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.067843 Apr 14 13:09:39 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 13:09:39 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:09:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:09:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001498 Apr 14 13:09:44 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 13:09:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:09:44 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:09:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-792a0dd3-86b1-40d3-826b-8f0ecbd36793 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.nano", "rxtx_factor": 1.0, "swap": 0, "id": "42", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 128}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:09:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-792a0dd3-86b1-40d3-826b-8f0ecbd36793 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068406 Apr 14 13:09:44 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 13:09:44 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:09:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-27cd5930-7a76-4f10-bfb1-444199b4e676 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:09:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-27cd5930-7a76-4f10-bfb1-444199b4e676 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026865 Apr 14 13:09:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 13:09:44 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:09:48 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:09:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-1da074bc-4828-4fc7-a497-3c899a354a6f admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001380 Apr 14 13:09:48 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 13:09:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:09:48 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-21d72ecb-daff-4237-8046-cc69d18a5fb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "84", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.micro", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 192}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:09:48 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-21d72ecb-daff-4237-8046-cc69d18a5fb2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071821 Apr 14 13:09:48 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 13:09:48 2023] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:09:48 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-74f4a151-e0ef-47b1-95e9-2abfa80ce204 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:09:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-74f4a151-e0ef-47b1-95e9-2abfa80ce204 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026079 Apr 14 13:09:48 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 13:09:48 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:12:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-8fdd0d89-9316-49b1-93a4-c57194417557 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'create', calling method: .version_select at 0x7fa748a9eef0>, body: {"keypair": {"name": "tempest-keypair-641815070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/dvc2S0OuXcn9jdXIUza2Um4pu7uvo7HYOG07F6fnb37QHZ7NdhG6QTqMXI3jbPISSO6VjhwOBRe6Loz+h6IedCzg/r0/inTPnR9XWKC/g2HpuZ9SyjRQ2J4QlDLD1WA=="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:18 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-8fdd0d89-9316-49b1-93a4-c57194417557 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting quotas for project a82aa8e6724a41e1a4e4d7783876536e. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:18 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-8fdd0d89-9316-49b1-93a4-c57194417557 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting quotas for user d7e4e432ab0d448db8c2437e40cbe0cd and project a82aa8e6724a41e1a4e4d7783876536e. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-8fdd0d89-9316-49b1-93a4-c57194417557 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.367008 Apr 14 13:12:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:12:18 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:23 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-303889780", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "70521388-2232-4fd0-a1b4-41b6901ac702"}], "security_groups": [{"name": "tempest-securitygroup--1171135687"}], "key_name": "tempest-keypair-641815070", "user_data": "}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:24 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:24 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] validate_networks() for [('70521388-2232-4fd0-a1b4-41b6901ac702', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:24 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1108872439", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "69762a08-01c9-4ee5-9118-3824b54739c4"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:24 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] validate_networks() for [('69762a08-01c9-4ee5-9118-3824b54739c4', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:25 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d8eaced1-ea24-416e-90b7-c867676a5592 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: .version_select at 0x7fa7489179a0>, body: {"keypair": {"name": "tempest-keypair-359510273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvwjWdhdL4p/vot8ehhliLkgSS+VX3N3hpUfRnGb4cxQCzMi+uh/nKjV34jvCMuz1AcDAnUhheia6vRHCdkI6iN4byvGQyKLEzU6N7m6Pa1bYwwTvypkLGfgAQNH5PIpA=="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:25 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-d8eaced1-ea24-416e-90b7-c867676a5592 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:25 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-d8eaced1-ea24-416e-90b7-c867676a5592 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for user 65812c6559684eddbdde33cd64ca1fba and project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d8eaced1-ea24-416e-90b7-c867676a5592 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094501 Apr 14 13:12:25 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 16/47] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:12:25 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:26 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Getting quotas for project 50d534e4c1cd4abb9204ce53e9a2a7b3. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:26 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Getting quotas for user 152f7a419a524915a216130426b32ea4 and project 50d534e4c1cd4abb9204ce53e9a2a7b3. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:26 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:26 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6a2d2fc5-d8b5-468c-9554-0fcc8c7e7f40 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.870651 Apr 14 13:12:26 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 1872 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:26 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-650ddee7-e25e-47a4-b3ac-9e9cdceafaa0 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:26 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-650ddee7-e25e-47a4-b3ac-9e9cdceafaa0 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:26 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-650ddee7-e25e-47a4-b3ac-9e9cdceafaa0 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152f7a419a524915a216130426b32ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d534e4c1cd4abb9204ce53e9a2a7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-650ddee7-e25e-47a4-b3ac-9e9cdceafaa0 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd" status: 200 len: 1209 microversion: 2.1 time: 0.288781 Apr 14 13:12:26 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 17/49] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:26 2023] GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd => generated 1209 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting quotas for project a82aa8e6724a41e1a4e4d7783876536e. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting quotas for user d7e4e432ab0d448db8c2437e40cbe0cd and project a82aa8e6724a41e1a4e4d7783876536e. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:26 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:27 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e58bf7a2-6174-4b72-ac09-61455bcbf9b6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.591057 Apr 14 13:12:27 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 17/50] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:23 2023] POST /compute/v2.1/servers => generated 400 bytes in 3594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:27 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-dbf70155-5707-4cd9-ac9c-ddd9a32936af tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:27 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-dbf70155-5707-4cd9-ac9c-ddd9a32936af tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:27 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-dbf70155-5707-4cd9-ac9c-ddd9a32936af tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:27 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-dbf70155-5707-4cd9-ac9c-ddd9a32936af tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1230 microversion: 2.1 time: 0.162286 Apr 14 13:12:27 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:27 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1230 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:12:28 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-299687148", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:28 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] validate_networks() for [('a2caff26-0e2b-4e61-8af1-e13eada766a1', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting quotas for project a7c8c8f620334166a141ea65525ba2a0. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting quotas for user 3948b7c643374bcdbeb34f0f2f790c3c and project a7c8c8f620334166a141ea65525ba2a0. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:30 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-c1a52cd6-605c-42a9-8ebc-c2b045d16835 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.686657 Apr 14 13:12:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 18/52] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:28 2023] POST /compute/v2.1/servers => generated 381 bytes in 2690 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:30 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c3c3b6dc-f510-419b-840a-0a649770be3f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:30 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-c3c3b6dc-f510-419b-840a-0a649770be3f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:31 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-c3c3b6dc-f510-419b-840a-0a649770be3f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:31 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c3c3b6dc-f510-419b-840a-0a649770be3f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 200 len: 1215 microversion: 2.1 time: 0.292594 Apr 14 13:12:31 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:30 2023] GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 1215 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:12:31 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1383992809", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:31 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] validate_networks() for [('a2caff26-0e2b-4e61-8af1-e13eada766a1', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e10eb2-a042-4916-8b61-51f7dcd731dd", "tag": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Creating event network-changed:2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance 62e10eb2-a042-4916-8b61-51f7dcd731dd on user Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61775) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b83c7d21-7ce5-4196-81f0-fed10ae4baac req-a6fd9473-32e3-477c-b539-aeb2edebb74e service nova] Acquired lock "compute-rpcapi-router" {{(pid=61775) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:33 user devstack@n-api.service[61775]: INFO nova.compute.rpcapi [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 13:12:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] Releasing lock "compute-rpcapi-router" {{(pid=61775) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 13:12:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ec5d2eb3-7d67-4579-8ea8-fe2070b05495 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140160 Apr 14 13:12:33 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 19/54] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting quotas for project a7c8c8f620334166a141ea65525ba2a0. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting quotas for user 3948b7c643374bcdbeb34f0f2f790c3c and project a7c8c8f620334166a141ea65525ba2a0. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:33 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:33 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e282a018-4995-425c-8c3a-18e9f80ffa5e tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.443927 Apr 14 13:12:33 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:31 2023] POST /compute/v2.1/servers => generated 381 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:33 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-761aed01-65fe-4068-afb8-2f20a649cb5c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:33 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-761aed01-65fe-4068-afb8-2f20a649cb5c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:33 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-761aed01-65fe-4068-afb8-2f20a649cb5c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-761aed01-65fe-4068-afb8-2f20a649cb5c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f" status: 200 len: 1216 microversion: 2.1 time: 0.131538 Apr 14 13:12:33 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 19/56] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:33 2023] GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f => generated 1216 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:12:34 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:34 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] Creating event network-changed:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:12:34 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-7eb06b15-250b-4681-9140-41f5c57240dd req-f55581c0-8d19-4cf7-917b-2e5d83660e8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116020 Apr 14 13:12:34 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 20/57] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:35 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1885721133", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd"}], "security_groups": [{"name": "tempest-securitygroup--379054878"}], "key_name": "tempest-keypair-359510273", "user_data": "}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:35 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] validate_networks() for [('2e129bf7-45b2-41b1-ba6f-5f7359c721bd', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for user 65812c6559684eddbdde33cd64ca1fba and project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:38 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-94f888a5-701b-4fdd-b334-0137b20e4f1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 3.675487 Apr 14 13:12:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:35 2023] POST /compute/v2.1/servers => generated 399 bytes in 3682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:38 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-044f7ba2-92f2-4051-99e3-c4f4a6545244 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:38 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-044f7ba2-92f2-4051-99e3-c4f4a6545244 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:38 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:38 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:39 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-044f7ba2-92f2-4051-99e3-c4f4a6545244 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-044f7ba2-92f2-4051-99e3-c4f4a6545244 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6" status: 200 len: 1235 microversion: 2.1 time: 0.196832 Apr 14 13:12:39 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 20/59] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:38 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => generated 1235 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:12:41 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=16 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:41 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e10eb2-a042-4916-8b61-51f7dcd731dd", "name": "network-vif-plugged", "status": "completed", "tag": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] Creating event network-vif-plugged:2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance 62e10eb2-a042-4916-8b61-51f7dcd731dd on user Apr 14 13:12:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-b3155f0e-8fe9-4e6d-a737-660f3d8beba2 req-dec9e573-f57e-42f7-a58d-bdee828343e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120554 Apr 14 13:12:41 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 21/60] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:41 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e1dc8f8e-cd17-4e35-812e-a1fe238caf66 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Action: 'create', calling method: .version_select at 0x7fa74898f010>, body: {"keypair": {"name": "tempest-keypair-482581034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdzdkPoVoit7lM3kjI305ncqTC0UPXvZNd8OkmDGnxotdmDaGo3cP0vK31jvHAe3ky9EBQegBgROUmRg4RyBIdIiQhUaixyXIvR1O427vpvxjKBK1aHC8LxkumxfrfRAQ=="}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:41 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-e1dc8f8e-cd17-4e35-812e-a1fe238caf66 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting quotas for project 9094bc9720194f02abdc6d0b081c7e32. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:41 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-e1dc8f8e-cd17-4e35-812e-a1fe238caf66 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting quotas for user f1387c0adbe74072b52886ddc2af4182 and project 9094bc9720194f02abdc6d0b081c7e32. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e1dc8f8e-cd17-4e35-812e-a1fe238caf66 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.241145 Apr 14 13:12:41 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:12:41 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:42 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:12:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-a8a65257-a61e-46a8-84fd-012c0e5ce569 req-1fb566bb-fb86-43fd-b7ef-a01c2f913ef9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030870 Apr 14 13:12:42 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 22/62] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:42 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f3d7d804-2c10-42ca-be4f-ae6d7aca88c0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Action: 'create', calling method: .version_select at 0x7fa7489abeb0>, body: {"keypair": {"name": "tempest-keypair-1829584132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYxk3GOGAG1sfjFiKz6paSv75v5clPigzUPtC8TeGwkIXNOYkWyvxuoItEv01kSH+0A15Mo9E2wd5OTeLGrgiAO+AQs620zYYvv7HS9vO8qQablNjVt9SJHTDMlXo19fA=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:42 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-f3d7d804-2c10-42ca-be4f-ae6d7aca88c0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Getting quotas for project c14f43e2f82342ddbdb5c4ceedc96936. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:42 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-f3d7d804-2c10-42ca-be4f-ae6d7aca88c0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Getting quotas for user 3975df3ad6084eee8bca5aedfc61ac95 and project c14f43e2f82342ddbdb5c4ceedc96936. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:42 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f3d7d804-2c10-42ca-be4f-ae6d7aca88c0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.220627 Apr 14 13:12:42 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:12:42 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}, {"server_uuid": "62e10eb2-a042-4916-8b61-51f7dcd731dd", "name": "network-vif-plugged", "status": "completed", "tag": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Creating event network-changed:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:12:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Creating event network-vif-plugged:2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance 62e10eb2-a042-4916-8b61-51f7dcd731dd on user Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61774) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-71dee134-6027-4933-83f0-1726777cf13c req-cc95b240-74bb-4c87-a1c1-28afe0ee02ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=61774) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:43 user devstack@n-api.service[61774]: INFO nova.compute.rpcapi [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 13:12:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] Releasing lock "compute-rpcapi-router" {{(pid=61774) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 13:12:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-d51f0806-b193-431f-a867-e34c3ebf5b50 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.105846 Apr 14 13:12:43 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:43 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:44 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:12:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-98b371f9-7b42-4381-ad66-708e47658724 req-39d999e9-3050-4669-8af4-bf01f817044f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048406 Apr 14 13:12:44 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 23/65] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] Creating event network-changed:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:12:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-37e69add-e1f5-4855-8c4c-6f5e28002621 req-a6f2188a-a5c2-4f13-b4c3-89748f54d196 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103056 Apr 14 13:12:46 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:46 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-feb9769c-335d-4373-8ac4-961f6bd537f1 req-1322a4cc-dc08-403d-a5da-25c9baddaa67 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:46 user devstack@n-api.service[61776]: INFO nova.compute.rpcapi [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 13:12:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] Releasing lock "compute-rpcapi-router" {{(pid=61776) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 13:12:46 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-71eab551-2e6e-4311-936d-aef30d895762 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.460065 Apr 14 13:12:46 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 22/67] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:48 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34d24a3-a632-4f05-b6fb-dc3562dc93d6", "tag": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4"}, {"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:48 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=5 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Creating event network-changed:5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 on user Apr 14 13:12:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:12:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-8cb8679d-eb0a-4918-b06d-b24f0588b4c1 req-e9ff892a-da2c-463e-be56-4d39f71a94d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087968 Apr 14 13:12:48 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 24/68] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-61c81993-f5ff-41fc-a89b-68536a144972 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Action: 'create', calling method: .version_select at 0x7fa743f4cb80>, body: {"keypair": {"name": "tempest-keypair-157168234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQGkfzhrgRQt3R+2yTZx1eIPdWpktZ8TGxkXnf/ktvKVPNojK9B8SUmMt34Q3Xrk7GLPxqU8Sg3MgwUeKs/D2/0ZoXxgbSLa7+dKYceaNQ0dza/dcfmvf3TnWbFUP+mKQ=="}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:49 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-61c81993-f5ff-41fc-a89b-68536a144972 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Getting quotas for project 18dfe057a9f742ceb908883f28463a43. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:49 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-61c81993-f5ff-41fc-a89b-68536a144972 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Getting quotas for user 8e33a6a8f8f441978437332de5499609 and project 18dfe057a9f742ceb908883f28463a43. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:50 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-61c81993-f5ff-41fc-a89b-68536a144972 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125948 Apr 14 13:12:50 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:12:49 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:50 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-plugged", "status": "completed", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}, {"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-plugged", "status": "completed", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Creating event network-vif-plugged:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:12:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] Creating event network-vif-plugged:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:12:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-b55cc36f-afde-43b5-adcb-e0ed72a6beba req-5e065075-4797-479e-9263-3e814b0d8adf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063830 Apr 14 13:12:50 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 23/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:50 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1633441671", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58"}], "security_groups": [{"name": "tempest-securitygroup--1736135280"}], "key_name": "tempest-keypair-482581034", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:51 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34d24a3-a632-4f05-b6fb-dc3562dc93d6", "name": "network-vif-plugged", "status": "completed", "tag": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] validate_networks() for [('ac0fadd7-d406-42a9-84c3-72fcfa33dc58', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:51 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] Creating event network-vif-plugged:5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 on user Apr 14 13:12:51 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-a3309bd9-2c2d-415c-b76e-f48acc267c41 req-1a08b3cd-945d-4b6f-ad1f-4a8cf198e64e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226386 Apr 14 13:12:51 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 24/71] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting quotas for project 9094bc9720194f02abdc6d0b081c7e32. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:51 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting quotas for user f1387c0adbe74072b52886ddc2af4182 and project 9094bc9720194f02abdc6d0b081c7e32. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:52 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:52 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:52 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-11385702-9d56-4d86-8dba-cdfa18846a80 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.259318 Apr 14 13:12:52 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 25/72] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:50 2023] POST /compute/v2.1/servers => generated 404 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:52 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4ab5bd31-ea25-44b7-9a4d-27e44c94cae6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:52 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4ab5bd31-ea25-44b7-9a4d-27e44c94cae6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:52 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=16 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:52 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-4ab5bd31-ea25-44b7-9a4d-27e44c94cae6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1387c0adbe74072b52886ddc2af4182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9094bc9720194f02abdc6d0b081c7e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4ab5bd31-ea25-44b7-9a4d-27e44c94cae6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a" status: 200 len: 1235 microversion: 2.1 time: 0.220722 Apr 14 13:12:52 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 24/73] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:52 2023] GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a => generated 1235 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:12:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1273980598", "imageRef": "73157366-43fa-48ac-9387-0ba6d7637222", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "8ce2e5cd-683e-4a90-9604-35890337ad09"}], "security_groups": [{"name": "tempest-securitygroup--937177"}], "key_name": "tempest-keypair-1829584132", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:52 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] validate_networks() for [('8ce2e5cd-683e-4a90-9604-35890337ad09', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a31b6a2b-72f2-4c59-918a-599ac34a8a97 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Action: 'create', calling method: .version_select at 0x7fa743f44310>, body: {"keypair": {"name": "tempest-keypair-1468650109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4duIqCv7vEVSja8IqrS2m8nOyBfEtm9GNp6oVWYmKH8ODAqPLRXepqVchMI9s9qHWy17HwfyhVBB5y+o51mGHAALloM+mnGYFQ/OSrPtSKKkLrtAKZzJf5wagS5jGc7w=="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34d24a3-a632-4f05-b6fb-dc3562dc93d6", "name": "network-vif-plugged", "status": "completed", "tag": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:53 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:53 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-a31b6a2b-72f2-4c59-918a-599ac34a8a97 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Getting quotas for project ab3a7e094618456381891d4532bb3cf2. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:53 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-a31b6a2b-72f2-4c59-918a-599ac34a8a97 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Getting quotas for user 016ee10024d2449c93d67e0b14f09f95 and project ab3a7e094618456381891d4532bb3cf2. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a31b6a2b-72f2-4c59-918a-599ac34a8a97 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.110911 Apr 14 13:12:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 26/74] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 13:12:53 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 13:12:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] Creating event network-vif-plugged:5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 on user Apr 14 13:12:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f36b4fdf-f19b-4354-8fde-98926d421257 req-22cb5dde-4f76-4bd9-a30d-7afdf198488f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107516 Apr 14 13:12:53 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 25/75] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-2039788772", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972"}], "security_groups": [{"name": "tempest-securitygroup--892022891"}], "key_name": "tempest-keypair-157168234", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2141644410", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a"}]}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:53 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] validate_networks() for [('c6dfe7b8-e16e-4c31-93b7-9e358f72de7a', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=8 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:54 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] validate_networks() for [('a6cc1384-1cb8-4f2a-96e5-0c15a6ee1972', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Getting quotas for project c14f43e2f82342ddbdb5c4ceedc96936. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Getting quotas for user 3975df3ad6084eee8bca5aedfc61ac95 and project c14f43e2f82342ddbdb5c4ceedc96936. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73157366-43fa-48ac-9387-0ba6d7637222',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ade4facc-2fda-4cf0-bb09-a599bb25f261 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.545047 Apr 14 13:12:54 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 25/76] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:52 2023] POST /compute/v2.1/servers => generated 400 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6596e440-7369-42ff-835e-182ba9d4ba54 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-6596e440-7369-42ff-835e-182ba9d4ba54 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-6596e440-7369-42ff-835e-182ba9d4ba54 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3975df3ad6084eee8bca5aedfc61ac95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14f43e2f82342ddbdb5c4ceedc96936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:54 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=35 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:12:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6596e440-7369-42ff-835e-182ba9d4ba54 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff" status: 200 len: 1240 microversion: 2.1 time: 0.107916 Apr 14 13:12:54 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 26/77] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:54 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:12:54 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:54 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:54 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:54 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:54 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Getting quotas for project e1c7d361867b4265bd4e1d13e9e66bc4. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Getting quotas for user 1c4166b50a7c49158acc8684eaee6041 and project e1c7d361867b4265bd4e1d13e9e66bc4. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Getting quotas for project 18dfe057a9f742ceb908883f28463a43. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Getting quotas for user 8e33a6a8f8f441978437332de5499609 and project 18dfe057a9f742ceb908883f28463a43. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:12:55 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:12:55 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-8bcdec6d-4c9d-4f0c-9748-90255d05bb53 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.503375 Apr 14 13:12:55 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 26/78] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 1508 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:55 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8da1666d-cbf8-4a3b-ab44-8c08cf5c3e5d tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:55 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8da1666d-cbf8-4a3b-ab44-8c08cf5c3e5d tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-00878e1a-a32c-4c6a-8e95-00cffd8c3558 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.623778 Apr 14 13:12:55 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 27/79] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:12:53 2023] POST /compute/v2.1/servers => generated 403 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-696e8cfd-a554-43cf-ad24-aa89b28d57e0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-696e8cfd-a554-43cf-ad24-aa89b28d57e0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:12:55 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-696e8cfd-a554-43cf-ad24-aa89b28d57e0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e33a6a8f8f441978437332de5499609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18dfe057a9f742ceb908883f28463a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:55 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-696e8cfd-a554-43cf-ad24-aa89b28d57e0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4" status: 200 len: 1225 microversion: 2.1 time: 0.129589 Apr 14 13:12:55 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 27/80] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:55 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4 => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:12:55 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-8da1666d-cbf8-4a3b-ab44-8c08cf5c3e5d tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4166b50a7c49158acc8684eaee6041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7d361867b4265bd4e1d13e9e66bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:12:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-8da1666d-cbf8-4a3b-ab44-8c08cf5c3e5d tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f" status: 200 len: 1208 microversion: 2.1 time: 0.325515 Apr 14 13:12:55 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 27/81] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:12:55 2023] GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f => generated 1208 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:12:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74c3463-6701-4150-9096-1775785e8e2a", "tag": "81acf974-1e47-44a8-822c-3d47187e3ae5"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:12:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:12:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:12:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] Creating event network-changed:81acf974-1e47-44a8-822c-3d47187e3ae5 for instance c74c3463-6701-4150-9096-1775785e8e2a on user Apr 14 13:12:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-e31ff4cc-0c2e-4912-a69c-97d00ba756c3 req-33967ffa-be05-44b3-908d-6db5ab4cfa82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078358 Apr 14 13:12:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:12:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:12:59 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1305382448", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "53eda3e7-82e5-4c42-81d1-a180eb205a2e"}], "security_groups": [{"name": "tempest-securitygroup--605863641"}], "key_name": "tempest-keypair-1468650109", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:12:59 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] validate_networks() for [('53eda3e7-82e5-4c42-81d1-a180eb205a2e', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:13:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9b4e51c-b24a-4025-8be1-4294d06c18ff", "tag": "c32a1dd7-ca19-4b21-8e75-1581be1c0374"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:00 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=17 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] Creating event network-changed:c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff on user Apr 14 13:13:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-294cc461-53c7-431b-bffc-a08aade8119c req-a6fb64e3-04a9-4b36-b403-bcd8652d9199 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113142 Apr 14 13:13:00 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Getting quotas for project ab3a7e094618456381891d4532bb3cf2. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Getting quotas for user 016ee10024d2449c93d67e0b14f09f95 and project ab3a7e094618456381891d4532bb3cf2. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:13:01 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:13:01 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4c12b5d7-5068-4c72-bdef-5ebe7760b722 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 2.743494 Apr 14 13:13:01 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 28/84] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 13:12:59 2023] POST /compute/v2.1/servers => generated 403 bytes in 2746 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:13:01 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-65c15378-33c3-4368-8902-cd1128faca4b tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:01 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-65c15378-33c3-4368-8902-cd1128faca4b tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:01 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-65c15378-33c3-4368-8902-cd1128faca4b tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:01 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-65c15378-33c3-4368-8902-cd1128faca4b tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:02 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-65c15378-33c3-4368-8902-cd1128faca4b tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:02 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-65c15378-33c3-4368-8902-cd1128faca4b tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7" status: 200 len: 1321 microversion: 2.49 time: 0.226312 Apr 14 13:13:02 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:13:01 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 13:13:02 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e058f6b1-e83b-49af-9ab3-a29b959f211f", "tag": "fe327006-c497-4b3f-8e4a-74a407193cb4"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:02 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:02 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:02 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:02 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] Creating event network-changed:fe327006-c497-4b3f-8e4a-74a407193cb4 for instance e058f6b1-e83b-49af-9ab3-a29b959f211f on user Apr 14 13:13:02 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-a8336bbd-b32b-47cb-9c11-90ffdafa3cfb req-9d9346fb-1dff-4bd4-be7c-06c561bb1e6b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062533 Apr 14 13:13:02 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 29/86] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:13:04 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74c3463-6701-4150-9096-1775785e8e2a", "name": "network-vif-plugged", "status": "completed", "tag": "81acf974-1e47-44a8-822c-3d47187e3ae5"}, {"server_uuid": "c74c3463-6701-4150-9096-1775785e8e2a", "name": "network-vif-plugged", "status": "completed", "tag": "81acf974-1e47-44a8-822c-3d47187e3ae5"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Creating event network-vif-plugged:81acf974-1e47-44a8-822c-3d47187e3ae5 for instance c74c3463-6701-4150-9096-1775785e8e2a on user Apr 14 13:13:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] Creating event network-vif-plugged:81acf974-1e47-44a8-822c-3d47187e3ae5 for instance c74c3463-6701-4150-9096-1775785e8e2a on user Apr 14 13:13:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-3e37a8f1-b9bf-473e-a288-509c2b68a643 req-05353481-3e90-4aff-b41d-01755085057e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063623 Apr 14 13:13:04 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 29/87] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b4e51c-b24a-4025-8be1-4294d06c18ff", "name": "network-vif-plugged", "status": "completed", "tag": "c32a1dd7-ca19-4b21-8e75-1581be1c0374"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:04 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=23 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:04 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] Creating event network-vif-plugged:c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff on user Apr 14 13:13:04 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-7b33eb3f-9b65-46e3-a339-7f54b8aa23f8 req-9163ede4-742d-40f3-bcbd-7dd13a8944e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127425 Apr 14 13:13:04 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 30/88] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:05 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:05 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990b083b-744a-42cb-88f3-7ae16a5abed4", "tag": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] Creating event network-changed:932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance 990b083b-744a-42cb-88f3-7ae16a5abed4 on user Apr 14 13:13:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-3b49996e-d296-4f24-b9b9-95d34e89cf19 req-ddc7671b-85d2-4266-a60a-7102b1822c79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064189 Apr 14 13:13:05 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:06 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b4e51c-b24a-4025-8be1-4294d06c18ff", "name": "network-vif-plugged", "status": "completed", "tag": "c32a1dd7-ca19-4b21-8e75-1581be1c0374"}, {"name": "network-changed", "server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "tag": "0946e034-1e6c-42d6-a8e2-1b24fabc000c"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Creating event network-vif-plugged:c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff on user Apr 14 13:13:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] Creating event network-changed:0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:13:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-72d1aea6-5385-4d3c-93f6-3c357af95298 req-c516c204-3c9b-4147-a232-de6058e7d2e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043109 Apr 14 13:13:06 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 30/90] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:06 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:07 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e058f6b1-e83b-49af-9ab3-a29b959f211f", "name": "network-vif-plugged", "status": "completed", "tag": "fe327006-c497-4b3f-8e4a-74a407193cb4"}, {"server_uuid": "e058f6b1-e83b-49af-9ab3-a29b959f211f", "name": "network-vif-plugged", "status": "completed", "tag": "fe327006-c497-4b3f-8e4a-74a407193cb4"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:07 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Creating event network-vif-plugged:fe327006-c497-4b3f-8e4a-74a407193cb4 for instance e058f6b1-e83b-49af-9ab3-a29b959f211f on user Apr 14 13:13:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] Creating event network-vif-plugged:fe327006-c497-4b3f-8e4a-74a407193cb4 for instance e058f6b1-e83b-49af-9ab3-a29b959f211f on user Apr 14 13:13:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-8594af88-a35f-48e9-9b97-21611c2f2f37 req-b6f66779-5a67-4fdd-aab7-1673b2012858 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055896 Apr 14 13:13:07 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990b083b-744a-42cb-88f3-7ae16a5abed4", "name": "network-vif-plugged", "status": "completed", "tag": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] Creating event network-vif-plugged:932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance 990b083b-744a-42cb-88f3-7ae16a5abed4 on user Apr 14 13:13:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-b8854563-18d4-4a31-b2ad-18abe2db9544 req-cc7e0ab8-3609-424c-b374-77d6915e0cf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119807 Apr 14 13:13:10 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-plugged", "status": "completed", "tag": "0946e034-1e6c-42d6-a8e2-1b24fabc000c"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:10 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=17 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] Creating event network-vif-plugged:0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:13:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-9be26ea8-5a54-4295-9a1c-a92f681a31e5 req-9008a7d8-28ea-4c26-8eb9-af8d5ff2c9a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056239 Apr 14 13:13:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 31/93] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-ef376796-9156-440d-bc30-efc52baabdfb tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Action: 'create', calling method: .version_select at 0x7fa743f452d0>, body: {"keypair": {"name": "tempest-keypair-1451174371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsp8l4eaXwcMmIYuHyn2U/Sj9XvKwggvsAXGzO6uV8BFNZli0UAQPjnkucPQBxBeyBTv1ueHbaQ06zf6HoCuSFstcikR64JZrVhuj9wkZtzs9UoQL/vneUqiLksZYL9ew=="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:11 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-ef376796-9156-440d-bc30-efc52baabdfb tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Getting quotas for project c9b68596374d4b918a83f403f2f25143. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:13:11 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-ef376796-9156-440d-bc30-efc52baabdfb tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Getting quotas for user e7115dcde1a6480e9e2db9cb8d4fdad3 and project c9b68596374d4b918a83f403f2f25143. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:13:11 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ef376796-9156-440d-bc30-efc52baabdfb tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.119537 Apr 14 13:13:11 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 32/94] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 13:13:10 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 13:13:12 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990b083b-744a-42cb-88f3-7ae16a5abed4", "name": "network-vif-plugged", "status": "completed", "tag": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] Creating event network-vif-plugged:932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance 990b083b-744a-42cb-88f3-7ae16a5abed4 on user Apr 14 13:13:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-49bc3663-e9ae-4919-bd68-5ed1b362ac5c req-bf4b3cc3-d328-46d9-a8bb-27e990cd43eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061331 Apr 14 13:13:12 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:12 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-plugged", "status": "completed", "tag": "0946e034-1e6c-42d6-a8e2-1b24fabc000c"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:12 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:12 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=16 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] Creating event network-vif-plugged:0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:13:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-6d5d87ea-649e-46b9-8c07-80d22ffdd1fc req-aba6acdf-fbaa-430a-9012-4e094d2d1af9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040177 Apr 14 13:13:12 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1062604462", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "792a09f0-bb03-4d2c-a902-a533c081fdda"}, {"port": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a", "tag": "port-1"}, {"port": "089a686b-763d-41df-b624-291933367593", "tag": "port-2"}, {"uuid": "58be4554-9763-4268-a91d-165d6628185f", "tag": "net-1"}, {"uuid": "58be4554-9763-4268-a91d-165d6628185f"}, {"uuid": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b79d1aea-eb7d-4506-88ad-47003a3aa2af", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6f1c3902-8299-4b2d-814c-3848a40fdb21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "09520b36-0291-4949-b4bd-5ef9452f1160", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f0db7698-a216-42b4-a592-80a4cb5568bc", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--842685833"}], "key_name": "tempest-keypair-1451174371", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:13 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] validate_networks() for [('792a09f0-bb03-4d2c-a902-a533c081fdda', None, None, None, None, None), (None, None, 'ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a', None, None, None), (None, None, '089a686b-763d-41df-b624-291933367593', None, None, None), ('58be4554-9763-4268-a91d-165d6628185f', None, None, None, None, None), ('58be4554-9763-4268-a91d-165d6628185f', None, None, None, None, None), ('b79d1aea-eb7d-4506-88ad-47003a3aa2af', '10.2.2.100', None, None, None, None), ('b79d1aea-eb7d-4506-88ad-47003a3aa2af', '10.2.2.200', None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:13:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-69c11bc0-fed9-46e7-8c7a-92132b80bb39 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Action: 'create', calling method: .version_select at 0x7fa7489cc940>, body: {"keypair": {"name": "tempest-keypair-293654497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX6FekRwnBEA/sEs6AI6iZf1H3yW2FT8Jg8nd7If2qFwFghf+BkdICvkDHmZWyKCbYmppphfQdV0/xSiQIuXMNk0wtEjR60YptAUpy24KeAYJFNvp8J9vN7YjlwPEX5dw=="}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:14 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-69c11bc0-fed9-46e7-8c7a-92132b80bb39 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Getting quotas for project 16235c48e6fb4457bbd7edfa321929a8. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:13:14 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-69c11bc0-fed9-46e7-8c7a-92132b80bb39 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Getting quotas for user 213b7b010b7f40b0946ec1575216e80d and project 16235c48e6fb4457bbd7edfa321929a8. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:13:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-69c11bc0-fed9-46e7-8c7a-92132b80bb39 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.090306 Apr 14 13:13:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 33/97] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 13:13:14 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 13:13:16 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1364405608", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "7e198958-bf78-4f31-a37f-fcf4eb24caa8"}, {"port": "3532d3d6-73ac-40eb-9486-d70fac78c992", "tag": "port-1"}, {"port": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047", "tag": "port-2"}, {"uuid": "7396885f-54d3-4b44-93c3-6628072d667b", "tag": "net-1"}, {"uuid": "7396885f-54d3-4b44-93c3-6628072d667b"}, {"uuid": "51c39db2-b137-4dff-8993-3a97bb48e38a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "51c39db2-b137-4dff-8993-3a97bb48e38a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "cfbc1718-f375-48f6-b94c-63ac9c4807a6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "24475c44-054d-436f-b2f8-17918c27ccc1", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1579291545"}], "key_name": "tempest-keypair-293654497", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:16 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] validate_networks() for [('7e198958-bf78-4f31-a37f-fcf4eb24caa8', None, None, None, None, None), (None, None, '3532d3d6-73ac-40eb-9486-d70fac78c992', None, None, None), (None, None, '3929e20e-3bcb-4e87-bbb3-59f52e6e7047', None, None, None), ('7396885f-54d3-4b44-93c3-6628072d667b', None, None, None, None, None), ('7396885f-54d3-4b44-93c3-6628072d667b', None, None, None, None, None), ('51c39db2-b137-4dff-8993-3a97bb48e38a', '10.2.2.100', None, None, None, None), ('51c39db2-b137-4dff-8993-3a97bb48e38a', '10.2.2.200', None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:16 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152f7a419a524915a216130426b32ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d534e4c1cd4abb9204ce53e9a2a7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:16 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-721290cc-73a3-412c-96d9-3f7703031edd tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd" status: 200 len: 1490 microversion: 2.1 time: 0.368909 Apr 14 13:13:16 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 34/98] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:16 2023] GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd => generated 1490 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Getting quotas for project c9b68596374d4b918a83f403f2f25143. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Getting quotas for user e7115dcde1a6480e9e2db9cb8d4fdad3 and project c9b68596374d4b918a83f403f2f25143. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:17 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a110914b-9c0a-42f1-8bad-2687679083ff tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1536 microversion: 2.1 time: 0.309317 Apr 14 13:13:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 35/99] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:17 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1536 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:13:17 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6f1c3902-8299-4b2d-814c-3848a40fdb21',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='09520b36-0291-4949-b4bd-5ef9452f1160',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0db7698-a216-42b4-a592-80a4cb5568bc',volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:13:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ef9c5641-4149-42c0-98e7-7358a55f5231 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 4.527524 Apr 14 13:13:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 33/100] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 13:13:13 2023] POST /compute/v2.1/servers => generated 403 bytes in 4529 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:13:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-dda42be6-ef81-4c53-9ef1-c006c9675d99 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:18 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-dda42be6-ef81-4c53-9ef1-c006c9675d99 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:18 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-dda42be6-ef81-4c53-9ef1-c006c9675d99 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:18 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-dda42be6-ef81-4c53-9ef1-c006c9675d99 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:18 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-dda42be6-ef81-4c53-9ef1-c006c9675d99 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-dda42be6-ef81-4c53-9ef1-c006c9675d99 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118" status: 200 len: 1280 microversion: 2.32 time: 0.093791 Apr 14 13:13:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 36/101] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:13:18 2023] GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Getting quotas for project 16235c48e6fb4457bbd7edfa321929a8. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Getting quotas for user 213b7b010b7f40b0946ec1575216e80d and project 16235c48e6fb4457bbd7edfa321929a8. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:13:19 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='2d98f66f-d116-4e53-9ad0-5fd2ecfad5c5',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cfbc1718-f375-48f6-b94c-63ac9c4807a6',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24475c44-054d-436f-b2f8-17918c27ccc1',volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:13:19 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-97af6eeb-1965-41d3-be5c-99aeccf5b8c1 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.640280 Apr 14 13:13:19 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 33/102] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 13:13:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 3643 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:13:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-61125933-439e-4360-a49e-4196c64b68f4 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:19 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-61125933-439e-4360-a49e-4196c64b68f4 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:20 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-61125933-439e-4360-a49e-4196c64b68f4 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:20 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-61125933-439e-4360-a49e-4196c64b68f4 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:20 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-61125933-439e-4360-a49e-4196c64b68f4 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-61125933-439e-4360-a49e-4196c64b68f4 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" status: 200 len: 1279 microversion: 2.42 time: 0.124785 Apr 14 13:13:20 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 34/103] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:13:19 2023] GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:13:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:23 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:24 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-08ad0cb6-708b-4f0c-8651-59871d905e08 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f" status: 200 len: 1503 microversion: 2.1 time: 0.345938 Apr 14 13:13:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 37/104] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:23 2023] GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f => generated 1503 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:25 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "tag": "97d7d320-4ac2-41af-86ca-c30f00808f33"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:25 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=9 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] Creating event network-changed:97d7d320-4ac2-41af-86ca-c30f00808f33 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-7c077004-b924-41d1-94c3-1da6e1ba837b req-927dc2fe-7ca7-45fd-9d4c-c775b5c24fb2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043777 Apr 14 13:13:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 34/105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:27 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "tag": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a"}, {"name": "network-changed", "server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "tag": "089a686b-763d-41df-b624-291933367593"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:27 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:27 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=5 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:27 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=11 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Creating event network-changed:ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] Creating event network-changed:089a686b-763d-41df-b624-291933367593 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-a1361157-35c9-4cf5-a763-427b70294329 req-bc94a8f1-0a8a-44c7-91ec-efc8c3033bb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040642 Apr 14 13:13:27 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:27 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:28 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "tag": "4fef6c1f-75be-46b1-b091-f3717d65bb21"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:28 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:28 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=40 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] Creating event network-changed:4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-46b1b14d-f058-4b06-97e3-acb9d7f4a913 req-9e2d17ab-daa8-419a-ba9c-364c2460f8eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035980 Apr 14 13:13:28 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 38/107] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:29 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "tag": "8a4f2864-33fc-4666-bb51-bdd01bc07af4"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:29 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] Creating event network-changed:8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:29 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-40ec0d7b-b807-49ca-aa89-c0f7b7a699cf req-40a34945-b531-41e3-8efb-026e084d0312 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030447 Apr 14 13:13:29 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 36/108] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:29 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-72d742df-7144-463c-b76d-b98aa1ba516e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6" status: 200 len: 1543 microversion: 2.1 time: 0.385377 Apr 14 13:13:29 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 35/109] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:29 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => generated 1543 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:29 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "tag": "96beb287-2181-4df4-b835-a9f071ace5df"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] Creating event network-changed:96beb287-2181-4df4-b835-a9f071ace5df for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-5f48c287-e534-443a-b945-c7908bd21352 req-16d8e85b-a82e-4a7a-9c13-d9781f2af174 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039434 Apr 14 13:13:29 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 39/110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:30 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=30 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "tag": "3532d3d6-73ac-40eb-9486-d70fac78c992"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] Creating event network-changed:3532d3d6-73ac-40eb-9486-d70fac78c992 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-55afe272-0eb2-48af-97eb-07ba02c16597 req-45acd721-7d1e-48c7-8d99-a734fa8c4716 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040243 Apr 14 13:13:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 37/111] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:31 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "tag": "c2904a0c-904d-4dc3-9ffc-aaa05e253319"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:31 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] Creating event network-changed:c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:31 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-8b3e0e0e-4b96-4b10-8858-be2d1e307107 req-7c7ef1ec-4ad9-4ba4-b23f-a7cc6a5ff679 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045063 Apr 14 13:13:31 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 36/112] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:31 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1440515588", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "548d2c7a-ae94-4d89-8980-cb14f224fca3"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:32 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] validate_networks() for [('548d2c7a-ae94-4d89-8980-cb14f224fca3', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:13:32 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "tag": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] Creating event network-changed:3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-19268a90-9f25-4ca0-a40d-f7578368f4fc req-c69f19be-e2e7-432f-b858-94e06806f206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028349 Apr 14 13:13:32 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 38/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:13:33 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "tag": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21"}, {"name": "network-changed", "server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "tag": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Creating event network-changed:3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] Creating event network-changed:1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-31081074-df0f-4c29-aac9-68f4fbadda61 req-e736ec4a-6f9b-4ffb-9f6f-077c6c13e43d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036008 Apr 14 13:13:33 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 37/114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:33 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=32 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting quotas for project 4fe64d1d65224162b60849eace352cb4. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting quotas for user 0f3445d14b0a44fd999bc2fc875c77bb and project 4fe64d1d65224162b60849eace352cb4. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:13:33 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:13:33 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-efcb68b1-fbad-41d9-b0fe-6b4b2286dd54 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.599604 Apr 14 13:13:33 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 40/115] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:13:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:13:33 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d1f7261f-e5ba-4a1e-89c3-c000ab5c15b5 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:33 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d1f7261f-e5ba-4a1e-89c3-c000ab5c15b5 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:33 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d1f7261f-e5ba-4a1e-89c3-c000ab5c15b5 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3445d14b0a44fd999bc2fc875c77bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe64d1d65224162b60849eace352cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d1f7261f-e5ba-4a1e-89c3-c000ab5c15b5 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5" status: 200 len: 1213 microversion: 2.1 time: 0.065887 Apr 14 13:13:33 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 39/116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:33 2023] GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:35 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "tag": "64455602-0478-47d7-9d50-551d552ceb26"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:35 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] Creating event network-changed:64455602-0478-47d7-9d50-551d552ceb26 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:35 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-1763eeef-0167-404b-9ee1-98dc6cc51705 req-bb16a03e-3fc3-453b-ae61-bacc13929354 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042441 Apr 14 13:13:35 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 38/117] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:36 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "tag": "8e63fe4d-bc87-40cb-855e-ad82726ca39d"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] Creating event network-changed:8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-db3204fd-e748-49dd-9417-001874a4cdb7 req-f6bb835a-8614-4027-8f2e-0f714fb1dcc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060157 Apr 14 13:13:36 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 41/118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:36 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387e72a2-6fd9-4cd7-ab72-67535fc67fd5", "tag": "dde4f0a3-4573-4f17-aa86-fef9fd14059e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:36 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] Creating event network-changed:dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 on user Apr 14 13:13:36 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-1c113dcf-ea7d-4bf8-beb2-dcda580d4bc1 req-072f7f59-4b3d-47eb-a7a6-10d3e2c44830 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044510 Apr 14 13:13:36 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 40/119] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "tag": "ff64a492-8e97-4c11-9207-bf56011d8a5d"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] Creating event network-changed:ff64a492-8e97-4c11-9207-bf56011d8a5d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-414422b7-c9a5-4e91-be9a-5b5c2760de4c req-6b82ce3f-7785-4066-928c-a3d6658aad5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034071 Apr 14 13:13:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 39/120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:39 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387e72a2-6fd9-4cd7-ab72-67535fc67fd5", "name": "network-vif-plugged", "status": "completed", "tag": "dde4f0a3-4573-4f17-aa86-fef9fd14059e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] Creating event network-vif-plugged:dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 on user Apr 14 13:13:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-e67d1bbc-b4d2-471a-94d5-5aad5b4741d7 req-2122c248-780b-4798-af8d-d1ed56801c6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041707 Apr 14 13:13:39 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 42/121] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:41 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387e72a2-6fd9-4cd7-ab72-67535fc67fd5", "name": "network-vif-plugged", "status": "completed", "tag": "dde4f0a3-4573-4f17-aa86-fef9fd14059e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] Creating event network-vif-plugged:dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 on user Apr 14 13:13:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-5a1e81d5-d8a9-4505-bf74-b4a83393a958 req-1c624de8-625b-42a2-9c99-335111aebfa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032918 Apr 14 13:13:41 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 41/122] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=22 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:42 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1387c0adbe74072b52886ddc2af4182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9094bc9720194f02abdc6d0b081c7e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:42 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ea78b7d7-b09e-4b9c-9d02-131119c55094 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a" status: 200 len: 1545 microversion: 2.1 time: 0.504845 Apr 14 13:13:42 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 40/123] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:42 2023] GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a => generated 1545 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:44 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3975df3ad6084eee8bca5aedfc61ac95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14f43e2f82342ddbdb5c4ceedc96936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6e24b293-01e3-4d70-9c6c-ead2f5570fa0 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff" status: 200 len: 1545 microversion: 2.1 time: 0.223868 Apr 14 13:13:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 43/124] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:44 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff => generated 1545 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:45 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e33a6a8f8f441978437332de5499609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18dfe057a9f742ceb908883f28463a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:45 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e68ec56b-9dbc-40dc-a973-04fecd69cd15 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4" status: 200 len: 1523 microversion: 2.1 time: 0.287141 Apr 14 13:13:45 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 42/125] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:45 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:45 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4166b50a7c49158acc8684eaee6041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7d361867b4265bd4e1d13e9e66bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-a30c0f83-c8eb-482c-b2e8-aede5c970269 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f" status: 200 len: 1486 microversion: 2.1 time: 0.262969 Apr 14 13:13:45 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 41/126] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:13:45 2023] GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f => generated 1486 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:13:48 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "4fef6c1f-75be-46b1-b091-f3717d65bb21"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] Creating event network-vif-plugged:4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-8ba901cf-1dae-4036-82aa-d1ca62e1563d req-98a37297-917b-4d46-93f7-762e5dcde571 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048237 Apr 14 13:13:48 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 44/127] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:49 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3532d3d6-73ac-40eb-9486-d70fac78c992"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] Creating event network-vif-plugged:3532d3d6-73ac-40eb-9486-d70fac78c992 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-d1876d74-9e49-4590-985c-dcc31c66210b req-58257394-6224-463a-ac4a-24f5bbfab885 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044370 Apr 14 13:13:49 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 43/128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:50 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "4fef6c1f-75be-46b1-b091-f3717d65bb21"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "64455602-0478-47d7-9d50-551d552ceb26"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "64455602-0478-47d7-9d50-551d552ceb26"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Creating event network-vif-plugged:4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Creating event network-vif-plugged:3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Creating event network-vif-plugged:3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Creating event network-vif-plugged:64455602-0478-47d7-9d50-551d552ceb26 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] Creating event network-vif-plugged:64455602-0478-47d7-9d50-551d552ceb26 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-cc8b1cf7-d197-4a0a-b269-1cdb69d50981 req-322ff3d2-0eb7-41eb-886e-191b87e47961 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.035951 Apr 14 13:13:50 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 42/129] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:50 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:51 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3532d3d6-73ac-40eb-9486-d70fac78c992"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:51 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Creating event network-vif-plugged:3532d3d6-73ac-40eb-9486-d70fac78c992 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:51 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Creating event network-vif-plugged:3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:51 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] Creating event network-vif-plugged:3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:51 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-d87a41ae-2989-4aa8-959a-b266277b2c88 req-8fcef66d-d0ab-4f9e-beba-42fd93c56d11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041245 Apr 14 13:13:51 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 45/130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:51 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:51 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "8e63fe4d-bc87-40cb-855e-ad82726ca39d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] Creating event network-vif-plugged:8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-14002c58-1e7f-437a-9d51-0d44dea27afd req-a0ab7f93-14d8-4cba-99d3-b9a36a20e2c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033276 Apr 14 13:13:51 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 44/131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:52 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:13:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-75bc0588-da00-4ab4-8cb7-b83125ea39e0 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7" status: 200 len: 1627 microversion: 2.49 time: 0.300289 Apr 14 13:13:52 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 43/132] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:13:52 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => generated 1627 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:13:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "ff64a492-8e97-4c11-9207-bf56011d8a5d"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "ff64a492-8e97-4c11-9207-bf56011d8a5d"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "089a686b-763d-41df-b624-291933367593"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Creating event network-vif-plugged:ff64a492-8e97-4c11-9207-bf56011d8a5d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Creating event network-vif-plugged:ff64a492-8e97-4c11-9207-bf56011d8a5d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] Creating event network-vif-plugged:089a686b-763d-41df-b624-291933367593 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-2aa82d2a-89f6-401d-b792-a20e5569a0c6 req-46f7f752-11bf-4f2c-911d-355371332518 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.099284 Apr 14 13:13:52 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 46/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:52 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "8e63fe4d-bc87-40cb-855e-ad82726ca39d"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "97d7d320-4ac2-41af-86ca-c30f00808f33"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "97d7d320-4ac2-41af-86ca-c30f00808f33"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "8a4f2864-33fc-4666-bb51-bdd01bc07af4"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Creating event network-vif-plugged:8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:13:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Creating event network-vif-plugged:97d7d320-4ac2-41af-86ca-c30f00808f33 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Creating event network-vif-plugged:97d7d320-4ac2-41af-86ca-c30f00808f33 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Creating event network-vif-plugged:ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Creating event network-vif-plugged:ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] Creating event network-vif-plugged:8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-464e1aa0-0453-4d1f-a15f-044d992f6b24 req-8db20b9b-071b-4ce9-a6c0-229586872d99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.057762 Apr 14 13:13:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 45/134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:53 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:13:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "c2904a0c-904d-4dc3-9ffc-aaa05e253319"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] Creating event network-vif-plugged:c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-8761e94d-0cd8-4565-8c94-479685f68352 req-67909b56-b9d3-4950-918b-09c6d3fe171e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388011 Apr 14 13:13:54 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 44/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:54 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "089a686b-763d-41df-b624-291933367593"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "96beb287-2181-4df4-b835-a9f071ace5df"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "96beb287-2181-4df4-b835-a9f071ace5df"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Creating event network-vif-plugged:089a686b-763d-41df-b624-291933367593 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Creating event network-vif-plugged:96beb287-2181-4df4-b835-a9f071ace5df for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] Creating event network-vif-plugged:96beb287-2181-4df4-b835-a9f071ace5df for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-7c6d2319-2411-495d-89f3-16be0ae50201 req-6b439ace-3f6e-422e-84ec-77249a2c67ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.031737 Apr 14 13:13:54 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 47/136] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:54 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:55 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "8a4f2864-33fc-4666-bb51-bdd01bc07af4"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] Creating event network-vif-plugged:8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-aba4f828-1433-47ac-951d-2501c87f35cb req-08f23577-9401-4ec5-9c93-9439b9aed0e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045475 Apr 14 13:13:55 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 46/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:13:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "c2904a0c-904d-4dc3-9ffc-aaa05e253319"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:13:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:13:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:13:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:13:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Creating event network-vif-plugged:c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Creating event network-vif-plugged:1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] Creating event network-vif-plugged:1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:13:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0ae29bd4-23c1-42ce-a42d-c7dcb1cefcd0 req-2d863fa7-b6ef-4135-923b-4fa8e35e495e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033333 Apr 14 13:13:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 45/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:13:56 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=19 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:08 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a9ed109b-80da-4b91-a2a5-8f1c508483d0 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118" status: 200 len: 2819 microversion: 2.32 time: 0.485603 Apr 14 13:14:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 48/139] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:14:08 2023] GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 => generated 2819 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=25 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=26 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:10 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-1931955d-ea26-4009-9ff1-316db8863ecf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" status: 200 len: 2825 microversion: 2.42 time: 0.554588 Apr 14 13:14:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 47/140] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:14:10 2023] GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => generated 2825 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=23 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=23 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:17 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-388473e6-3ec9-4111-8ee3-9a148516674e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.230882 Apr 14 13:14:17 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 46/141] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:14:17 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/os-interface => generated 282 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41f13b08-309d-4583-95cd-52c5551df3c1"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] Creating event network-changed:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:14:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-250af0ae-50d9-472e-a912-99bc04424367 req-6c8557bd-784b-401e-9911-39fdb3a73cff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056262 Apr 14 13:14:19 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 48/142] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:19 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:19 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:19 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-edb3fdb9-d955-46f5-ab99-b4a72b3502e6 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/ips" status: 200 len: 144 microversion: 2.1 time: 0.049112 Apr 14 13:14:19 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 47/143] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:14:19 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/ips => generated 144 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9a36b560-0113-4cbf-adf6-641355a21f06 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "POST /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800119 Apr 14 13:14:20 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 49/144] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:14:19 2023] POST /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd/os-volume_attachments => generated 194 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:22 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f6a3c6d-43d9-4137-b0e1-699b36e9b999"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:22 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:22 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d636779a-b40a-4774-9f80-53ba8a5a1e57 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.593835 Apr 14 13:14:22 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 49/145] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:14:22 2023] POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/os-volume_attachments => generated 194 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:23 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3445d14b0a44fd999bc2fc875c77bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe64d1d65224162b60849eace352cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4e14e714-d68c-4681-ad4c-545f317dfe0d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5" status: 200 len: 1496 microversion: 2.1 time: 0.224626 Apr 14 13:14:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 48/146] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:14:23 2023] GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => generated 1496 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:24 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'flavor' on Instance uuid cc4631eb-ae5b-4efa-9def-c0c45f56f40f {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:14:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-947bf8d4-2a29-48bc-b0a6-768e141d47f2 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/action" status: 200 len: 32 microversion: 2.1 time: 0.151228 Apr 14 13:14:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 50/147] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:14:24 2023] POST /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:24 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d0556f54-ee0d-4dec-a4fd-7590e51923ad tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f" status: 200 len: 1509 microversion: 2.1 time: 0.238016 Apr 14 13:14:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 50/148] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:14:24 2023] GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:14:25 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-unplugged", "status": "completed", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] Creating event network-vif-unplugged:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:14:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-858dfff5-4764-4f53-9022-1be4967538bd req-790ba4c5-5ef4-45ff-9caf-607fff827aca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049389 Apr 14 13:14:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 49/149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:27 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-plugged", "status": "completed", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:27 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] Creating event network-vif-plugged:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:14:27 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-ce4c0fe3-e1bd-4841-be89-de1f79771b7d req-189a22f6-f08e-4d37-8727-116f0958dd87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029781 Apr 14 13:14:27 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 51/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:27 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:14:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a168f309-2f34-42d2-bbb0-2c1871606b33 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd" status: 204 len: 0 microversion: 2.1 time: 0.152613 Apr 14 13:14:27 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 51/151] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:14:27 2023] DELETE /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:14:27 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:27 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:28 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '152f7a419a524915a216130426b32ea4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d534e4c1cd4abb9204ce53e9a2a7b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-10b3071e-0a58-457d-850c-5dff1d70501e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd" status: 200 len: 1542 microversion: 2.1 time: 0.252754 Apr 14 13:14:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 50/152] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:14:27 2023] GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd => generated 1542 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:14:28 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e10eb2-a042-4916-8b61-51f7dcd731dd", "name": "network-vif-unplugged", "status": "completed", "tag": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] Creating event network-vif-unplugged:2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance 62e10eb2-a042-4916-8b61-51f7dcd731dd on user Apr 14 13:14:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-f592f3ee-fea4-4adb-862c-90f2d760e8dd req-8fee21cc-b13d-4ad2-b6d9-11b2f043809f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041503 Apr 14 13:14:28 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 52/153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:29 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-plugged", "status": "completed", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}, {"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-plugged", "status": "completed", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:29 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Creating event network-vif-plugged:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:14:29 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] Creating event network-vif-plugged:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:14:29 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-524fb018-c326-4ece-ad54-8615ca68d397 req-a6c394df-4647-4393-b59e-8d5460f2f0ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035740 Apr 14 13:14:29 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 52/154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:29 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:30 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-737fd537-3598-4619-8fa6-1c3fe0a5e4a5 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.606167 Apr 14 13:14:30 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 51/155] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:14:29 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-interface => generated 282 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:14:30 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:30 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Going to try to stop instance {{(pid=61774) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e10eb2-a042-4916-8b61-51f7dcd731dd", "name": "network-vif-plugged", "status": "completed", "tag": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] Creating event network-vif-plugged:2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance 62e10eb2-a042-4916-8b61-51f7dcd731dd on user Apr 14 13:14:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-c751fb6d-67f7-4a00-8f4b-09b9f8d2fb34 req-63516b36-5303-4f79-9556-cc88f647dfcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041166 Apr 14 13:14:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 53/156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:30 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-5d08396a-3230-41b3-a261-3ee6be755346 req-3c046714-d9af-4826-b490-25af1e03285a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e10eb2-a042-4916-8b61-51f7dcd731dd", "name": "network-vif-deleted", "tag": "2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:30 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-2c523a32-7e09-4f43-a8f0-0c62e1b99d2a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.124411 Apr 14 13:14:30 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 53/157] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:14:30 2023] POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:14:30 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5d08396a-3230-41b3-a261-3ee6be755346 req-3c046714-d9af-4826-b490-25af1e03285a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:30 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5d08396a-3230-41b3-a261-3ee6be755346 req-3c046714-d9af-4826-b490-25af1e03285a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:30 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5d08396a-3230-41b3-a261-3ee6be755346 req-3c046714-d9af-4826-b490-25af1e03285a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:30 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-5d08396a-3230-41b3-a261-3ee6be755346 req-3c046714-d9af-4826-b490-25af1e03285a service nova] Creating event network-vif-deleted:2255403b-5bf0-4e2c-a1ae-0b8d5dea3b74 for instance 62e10eb2-a042-4916-8b61-51f7dcd731dd on user Apr 14 13:14:30 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-5d08396a-3230-41b3-a261-3ee6be755346 req-3c046714-d9af-4826-b490-25af1e03285a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035438 Apr 14 13:14:30 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 52/158] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:30 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e9730b5a-f585-4035-891c-5f2054c20a53 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1711 microversion: 2.1 time: 0.307161 Apr 14 13:14:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 54/159] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:14:30 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1711 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:14:31 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:31 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:31 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-4ba5fc1a-5945-41d1-a80c-d0f1fde88fad tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/ips" status: 200 len: 107 microversion: 2.1 time: 0.037646 Apr 14 13:14:31 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 54/160] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:14:31 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/ips => generated 107 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:32 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34d24a3-a632-4f05-b6fb-dc3562dc93d6", "tag": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:32 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] Creating event network-changed:5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 on user Apr 14 13:14:32 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-b09760ea-0ef6-492b-8056-5ab27513554b req-4dad06b1-cbc3-4c2e-8754-56a25a030486 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029149 Apr 14 13:14:32 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:32 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}, {"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Creating event network-vif-unplugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:14:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:14:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-fa44fad9-3e78-40d2-b3fb-d49f278c04d0 req-55190e19-1c8a-4e40-bb08-5fd70cb76abd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029174 Apr 14 13:14:32 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 55/162] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:32 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:34 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49056810-6abe-48de-b4bd-71d9f5d45096"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:34 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:34 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-01af81d9-3530-4464-b92c-f5ebebe2361e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.413743 Apr 14 13:14:34 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 55/163] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:14:34 2023] POST /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-volume_attachments => generated 194 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:42 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c7407940-0ab7-4803-9001-3c44dc1ae282 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: .version_select at 0x7fa743e36d40>, body: {"keypair": {"name": "tempest-keypair-713053172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/584IerZHYCW7Vrg1ZzlqOqLu8QT1OK09DsRuAHJ64sJni4ga/8sJVg77u23BliovVhhCBDFa6Zfrn5rTMjHEinlCzk/yYvmpWxEgtFvbxo0L3max/KhBCJVMGH9tZ2g=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:42 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-c7407940-0ab7-4803-9001-3c44dc1ae282 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:14:42 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-c7407940-0ab7-4803-9001-3c44dc1ae282 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for user 65812c6559684eddbdde33cd64ca1fba and project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:14:42 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c7407940-0ab7-4803-9001-3c44dc1ae282 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046035 Apr 14 13:14:42 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 54/164] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:14:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9ea293c3-1504-44e0-88dd-366cbd2412ba tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.461399 Apr 14 13:14:43 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 56/165] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:14:43 2023] GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-interface => generated 282 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-635632514", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd"}], "security_groups": [{"name": "tempest-securitygroup--1616358786"}], "key_name": "tempest-keypair-713053172", "user_data": "}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:43 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] validate_networks() for [('2e129bf7-45b2-41b1-ba6f-5f7359c721bd', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for user 65812c6559684eddbdde33cd64ca1fba and project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:14:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1c14d877-1633-452a-a1b7-c6cb0e3a9ee8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.690255 Apr 14 13:14:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 56/166] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:14:43 2023] POST /compute/v2.1/servers => generated 400 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:14:44 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=30 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f2402ac0-07db-41a1-a208-11c24364fa8c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:44 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-f2402ac0-07db-41a1-a208-11c24364fa8c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:44 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-f2402ac0-07db-41a1-a208-11c24364fa8c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f2402ac0-07db-41a1-a208-11c24364fa8c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372" status: 200 len: 1234 microversion: 2.1 time: 0.069028 Apr 14 13:14:44 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:14:44 2023] GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 => generated 1234 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:14:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74c3463-6701-4150-9096-1775785e8e2a", "tag": "81acf974-1e47-44a8-822c-3d47187e3ae5"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] Creating event network-changed:81acf974-1e47-44a8-822c-3d47187e3ae5 for instance c74c3463-6701-4150-9096-1775785e8e2a on user Apr 14 13:14:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-a3d7b694-180d-4f2a-b143-84423fdfa9bc req-12306bf2-d258-43c3-82a1-84853d438d90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035853 Apr 14 13:14:44 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1ac3caa6-0fb5-4c8e-8464-191207e5447f tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.220739 Apr 14 13:14:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:14:44 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-interface => generated 282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:45 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:45 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:46 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-621e908d-2d52-425b-ae03-983b940e08f6 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.283101 Apr 14 13:14:46 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 56/170] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:14:45 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-interface => generated 282 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:46 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9b4e51c-b24a-4025-8be1-4294d06c18ff", "tag": "c32a1dd7-ca19-4b21-8e75-1581be1c0374"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] Creating event network-changed:c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff on user Apr 14 13:14:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-dc038592-7f30-4334-a13a-4aa463709cab req-5634710c-5abf-4881-8922-89b8832ad089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032269 Apr 14 13:14:46 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 58/171] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:14:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-0e42f8f8-cf6e-46b9-b3f0-49d25de7c643 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f" status: 204 len: 0 microversion: 2.1 time: 0.197516 Apr 14 13:14:46 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:14:46 2023] DELETE /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:14:46 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:46 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c84a2c9-e024-4e22-bf1f-3c65264d17a0"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990b083b-744a-42cb-88f3-7ae16a5abed4", "tag": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] Creating event network-changed:932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance 990b083b-744a-42cb-88f3-7ae16a5abed4 on user Apr 14 13:14:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-17e3f127-7eb6-41b2-96b2-c6308bec28c2 req-cf0c5731-6e1e-403c-bef0-d49bc7bf7b02 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035440 Apr 14 13:14:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 59/173] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ddfd1c1-8f03-4f07-a754-304e70750e92"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:47 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4166b50a7c49158acc8684eaee6041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7d361867b4265bd4e1d13e9e66bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-dc81de8a-dbb5-44d8-8178-a8a4cc8bd890 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f" status: 200 len: 1492 microversion: 2.1 time: 0.614827 Apr 14 13:14:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 57/174] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:14:46 2023] GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f => generated 1492 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:14:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e058f6b1-e83b-49af-9ab3-a29b959f211f", "name": "network-vif-unplugged", "status": "completed", "tag": "fe327006-c497-4b3f-8e4a-74a407193cb4"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-8a204823-6dc4-4e01-aa2e-3b5bdabb0742 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354047 Apr 14 13:14:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 59/175] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:14:47 2023] POST /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments => generated 194 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] Creating event network-vif-unplugged:fe327006-c497-4b3f-8e4a-74a407193cb4 for instance e058f6b1-e83b-49af-9ab3-a29b959f211f on user Apr 14 13:14:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-98aa5445-b118-4c13-936f-4e34dc805b1f req-00104044-ae65-4c31-8760-af6f60f90b07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037617 Apr 14 13:14:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 58/176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:47 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=10,nova_cell1:INSERT=5 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-8a993290-629d-4b2b-9f27-9169de3d9798 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "POST /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406636 Apr 14 13:14:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 60/177] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:14:47 2023] POST /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:48 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6129a78c-9792-4a9b-b24f-bf4740cbc012"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:48 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-13c9a863-8981-44b0-a069-a3ae5004b6df tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316128 Apr 14 13:14:48 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 60/178] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:14:48 2023] POST /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:49 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-32fc33e2-f3d7-4ef7-a69e-35f37e315703 req-2ec7381a-78c3-4390-bce9-fc786afb0d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e058f6b1-e83b-49af-9ab3-a29b959f211f", "name": "network-vif-deleted", "tag": "fe327006-c497-4b3f-8e4a-74a407193cb4"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:49 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-32fc33e2-f3d7-4ef7-a69e-35f37e315703 req-2ec7381a-78c3-4390-bce9-fc786afb0d8b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-32fc33e2-f3d7-4ef7-a69e-35f37e315703 req-2ec7381a-78c3-4390-bce9-fc786afb0d8b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-32fc33e2-f3d7-4ef7-a69e-35f37e315703 req-2ec7381a-78c3-4390-bce9-fc786afb0d8b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-32fc33e2-f3d7-4ef7-a69e-35f37e315703 req-2ec7381a-78c3-4390-bce9-fc786afb0d8b service nova] Creating event network-vif-deleted:fe327006-c497-4b3f-8e4a-74a407193cb4 for instance e058f6b1-e83b-49af-9ab3-a29b959f211f on user Apr 14 13:14:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-32fc33e2-f3d7-4ef7-a69e-35f37e315703 req-2ec7381a-78c3-4390-bce9-fc786afb0d8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034153 Apr 14 13:14:49 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 59/179] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24179ea7-82e2-48fd-9aab-2e3bf7edb372", "tag": "c1984923-9c3a-400f-9e54-c4bc6b476074"}, {"server_uuid": "e058f6b1-e83b-49af-9ab3-a29b959f211f", "name": "network-vif-plugged", "status": "completed", "tag": "fe327006-c497-4b3f-8e4a-74a407193cb4"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:49 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Creating event network-changed:c1984923-9c3a-400f-9e54-c4bc6b476074 for instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 on user Apr 14 13:14:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] Creating event network-vif-plugged:fe327006-c497-4b3f-8e4a-74a407193cb4 for instance e058f6b1-e83b-49af-9ab3-a29b959f211f on user Apr 14 13:14:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-18dbe6e6-6be3-4c99-81dd-00dc3c56ce82 req-8773cc30-4edb-46e9-8ce0-b28319c43278 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046753 Apr 14 13:14:49 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 61/180] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:49 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:51 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24179ea7-82e2-48fd-9aab-2e3bf7edb372", "name": "network-vif-plugged", "status": "completed", "tag": "c1984923-9c3a-400f-9e54-c4bc6b476074"}, {"server_uuid": "24179ea7-82e2-48fd-9aab-2e3bf7edb372", "name": "network-vif-plugged", "status": "completed", "tag": "c1984923-9c3a-400f-9e54-c4bc6b476074"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Creating event network-vif-plugged:c1984923-9c3a-400f-9e54-c4bc6b476074 for instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 on user Apr 14 13:14:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] Creating event network-vif-plugged:c1984923-9c3a-400f-9e54-c4bc6b476074 for instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 on user Apr 14 13:14:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-899237d9-4fe0-4fae-9400-709fc92cf470 req-3cc63c7f-8214-4e54-a105-4733f1bc6a1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028981 Apr 14 13:14:51 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 61/181] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:51 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:52 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:52 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-b41425cd-30bb-4dbd-82eb-bbdc84c11d85 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.213972 Apr 14 13:14:52 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 60/182] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 13:14:52 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-interface => generated 283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:14:53 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "tag": "0946e034-1e6c-42d6-a8e2-1b24fabc000c"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] Creating event network-changed:0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:14:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-2c2db566-2985-4014-a905-1839a938b3fc req-6bffa2f6-47cd-447b-a687-da3fdd15c1ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034102 Apr 14 13:14:53 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 62/183] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:53 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:14:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d2ce6519-b474-48bb-b9f2-66acca76e2b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7" status: 200 len: 1627 microversion: 2.49 time: 0.285062 Apr 14 13:14:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 62/184] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:14:53 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => generated 1627 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:14:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "6601e2e2-96c0-4f49-8364-366da0f3a5a9", "tag": "nic-tag"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:53 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:54 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:54 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:54 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:14:55 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3bfe6502-3c9d-4714-a244-31792062ae86"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:55 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-062bcddb-5289-4a1a-8057-955abfbca428 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments/3ddfd1c1-8f03-4f07-a754-304e70750e92" status: 202 len: 0 microversion: 2.1 time: 0.581633 Apr 14 13:14:55 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 63/185] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 13:14:54 2023] PUT /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments/3ddfd1c1-8f03-4f07-a754-304e70750e92 => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:14:55 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "tag": "86f24d4d-809a-47a3-9ca5-b45042e95ce8"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] Creating event network-changed:86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:14:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-639181eb-abf5-4d9d-932b-e98f2fdc6df3 req-6e49bed0-6f07-46bf-9a41-c046f6670d42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031288 Apr 14 13:14:55 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 63/186] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:14:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-plugged", "status": "completed", "tag": "86f24d4d-809a-47a3-9ca5-b45042e95ce8"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] Creating event network-vif-plugged:86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:14:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-09485d93-6983-4c37-bb03-ba8bc2a5ca73 req-ff08a246-8cbe-48f6-a202-e4f33834240e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058185 Apr 14 13:14:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 64/187] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:14:57 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-43ee3021-5f1b-4e0e-aee6-cc8fc2bc10b5 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.475591 Apr 14 13:14:57 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 61/188] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 13:14:53 2023] POST /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-interface => generated 283 bytes in 3480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:14:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de854352-8b0b-4f27-ad88-9714392f776d", "tag": "volume-tag"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:57 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0ef9fd98-ef53-408f-bf26-3de77e726ebb tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "POST /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.370161 Apr 14 13:14:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 64/189] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 13:14:57 2023] POST /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7ce310e4-4a7c-4d83-8932-ce445d222cd9"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] HTTP exception thrown: Volume 7ce310e4-4a7c-4d83-8932-ce445d222cd9 could not be found. Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Request method failure captured: Apr 14 13:14:58 user devstack@n-api.service[61774]: request: PUT /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments/3c84a2c9-e024-4e22-bf1f-3c65264d17a0 HTTP/1.1 Apr 14 13:14:58 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:14:58 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:14:58 user devstack@n-api.service[61774]: Connection: close Apr 14 13:14:58 user devstack@n-api.service[61774]: Content-Length: 74 Apr 14 13:14:58 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:14:58 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:14:58 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:14:58 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVFJk7QazRdOmTspMFrsZpsCUBDsLxEiFawGPtiRTZ3Kk2xlT0MAx0z6qsQLsjF52s50HfGaiyfLvuTmKpI11wS--5_oH5GZwgCCYLo-ExC1s3jf-EN4tNbRZwpLUB9Sx_JwvutzKy2eOUNpCx17KjvGpgePxESP4l2x6M81ejcs--0 Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Project-Id: 6af20cbafad748da99bae1629d07c124 Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Project-Name: tempest-VolumesAdminNegativeTest-900239531 Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Role: reader,admin,member Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Roles: reader,admin,member Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6af20cbafad748da99bae1629d07c124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6af20cbafad748da99bae1629d07c124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6af20cbafad748da99bae1629d07c124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Tenant: tempest-VolumesAdminNegativeTest-900239531 Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Tenant-Id: 6af20cbafad748da99bae1629d07c124 Apr 14 13:14:58 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-900239531 Apr 14 13:14:58 user devstack@n-api.service[61774]: X-User: tempest-VolumesAdminNegativeTest-900239531-project-admin Apr 14 13:14:58 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:14:58 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:14:58 user devstack@n-api.service[61774]: X-User-Id: 51bda014c18844e0a685a23e2ff48354 Apr 14 13:14:58 user devstack@n-api.service[61774]: X-User-Name: tempest-VolumesAdminNegativeTest-900239531-project-admin Apr 14 13:14:58 user devstack@n-api.service[61774]: Apr 14 13:14:58 user devstack@n-api.service[61774]: {"volumeAttachment": {"volumeId": "7ce310e4-4a7c-4d83-8932-ce445d222cd9"}} Apr 14 13:14:58 user devstack@n-api.service[61774]: method: > Apr 14 13:14:58 user devstack@n-api.service[61774]: exception: Volume 7ce310e4-4a7c-4d83-8932-ce445d222cd9 could not be found. Apr 14 13:14:58 user devstack@n-api.service[61774]: action_args: {'server_id': 'c74c3463-6701-4150-9096-1775785e8e2a', 'id': '3c84a2c9-e024-4e22-bf1f-3c65264d17a0', 'body': {'volumeAttachment': {'volumeId': '7ce310e4-4a7c-4d83-8932-ce445d222cd9'}}} Apr 14 13:14:58 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ce310e4-4a7c-4d83-8932-ce445d222cd9 could not be found. (HTTP 404) (Request-ID: req-cb3d835a-9ae2-4dc2-b0e0-dd76cdacc783) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ce310e4-4a7c-4d83-8932-ce445d222cd9 could not be found. Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 7ce310e4-4a7c-4d83-8932-ce445d222cd9 could not be found. Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ce310e4-4a7c-4d83-8932-ce445d222cd9 could not be found. Apr 14 13:14:58 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:14:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Returning 400 to user: Volume 7ce310e4-4a7c-4d83-8932-ce445d222cd9 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:14:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-3664c908-4a4c-4014-bf72-742be938d078 tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments/3c84a2c9-e024-4e22-bf1f-3c65264d17a0" status: 400 len: 107 microversion: 2.1 time: 0.310105 Apr 14 13:14:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 65/190] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 13:14:58 2023] PUT /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments/3c84a2c9-e024-4e22-bf1f-3c65264d17a0 => generated 107 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:58 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lazy-loading 'services' on Instance uuid c74c3463-6701-4150-9096-1775785e8e2a {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:14:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-b6cac66a-2c35-4d49-b099-03909d68d613 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments/3c84a2c9-e024-4e22-bf1f-3c65264d17a0" status: 202 len: 0 microversion: 2.1 time: 0.245215 Apr 14 13:14:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 62/191] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:14:58 2023] DELETE /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments/3c84a2c9-e024-4e22-bf1f-3c65264d17a0 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:14:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:14:58 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:14:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:58 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0772e23a-1e7f-4b5f-89db-c92ee20539c6 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048204 Apr 14 13:14:58 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:14:58 2023] GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:14:59 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-plugged", "status": "completed", "tag": "86f24d4d-809a-47a3-9ca5-b45042e95ce8"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:14:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:14:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:14:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:14:59 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] Creating event network-vif-plugged:86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:14:59 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-9266726b-481a-4365-9a72-c9ac26583e03 req-afa84258-2550-49b1-95e7-96dce842b6c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054721 Apr 14 13:14:59 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 66/193] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:14:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:00 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:01 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:01 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-5a6d1ab8-4a37-47cd-9027-63c8b2387834 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048966 Apr 14 13:15:01 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 63/194] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:00 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:01 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lazy-loading 'services' on Instance uuid f9b4e51c-b24a-4025-8be1-4294d06c18ff {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:15:01 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-072afe34-b35b-4446-9be1-960551b000d2 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments/6129a78c-9792-4a9b-b24f-bf4740cbc012" status: 202 len: 0 microversion: 2.1 time: 0.252045 Apr 14 13:15:01 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:15:01 2023] DELETE /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments/6129a78c-9792-4a9b-b24f-bf4740cbc012 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-fda12807-a61a-4ab3-8e1c-723fad7b0721 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047063 Apr 14 13:15:03 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:03 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c1b08469-22c5-450f-9bdc-0b8f3de96590 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048815 Apr 14 13:15:03 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 64/197] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:03 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:15:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9f9a4ad4-12c9-4766-8518-5f38990ee553 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff" status: 204 len: 0 microversion: 2.1 time: 0.114566 Apr 14 13:15:03 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:15:03 2023] DELETE /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3975df3ad6084eee8bca5aedfc61ac95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c14f43e2f82342ddbdb5c4ceedc96936', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-aedc1275-2791-4763-9f77-8aa27784027e tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff" status: 200 len: 1670 microversion: 2.1 time: 0.290573 Apr 14 13:15:03 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 68/199] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:03 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b4e51c-b24a-4025-8be1-4294d06c18ff", "name": "network-vif-unplugged", "status": "completed", "tag": "c32a1dd7-ca19-4b21-8e75-1581be1c0374"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] Creating event network-vif-unplugged:c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff on user Apr 14 13:15:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-919f8cc3-0eb2-4b9f-a2e3-c93a8a2a708b req-1fa0df0d-3669-467d-b2b2-9c0b238f12cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044138 Apr 14 13:15:03 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 65/200] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b4e51c-b24a-4025-8be1-4294d06c18ff", "name": "network-vif-deleted", "tag": "c32a1dd7-ca19-4b21-8e75-1581be1c0374"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] Creating event network-vif-deleted:c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff on user Apr 14 13:15:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-23703f66-c55c-4602-ac03-1660a56e14a5 req-4cf6c1b5-cc39-45e9-b81d-ed426c4875d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034951 Apr 14 13:15:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 68/201] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9b4e51c-b24a-4025-8be1-4294d06c18ff", "name": "network-vif-plugged", "status": "completed", "tag": "c32a1dd7-ca19-4b21-8e75-1581be1c0374"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] Creating event network-vif-plugged:c32a1dd7-ca19-4b21-8e75-1581be1c0374 for instance f9b4e51c-b24a-4025-8be1-4294d06c18ff on user Apr 14 13:15:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-779a8a3b-b3f7-4e63-8e3e-f8319e88c682 req-be5acbd2-9e5f-4c70-9f42-1fc43e9f6150 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030549 Apr 14 13:15:05 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 69/202] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:09 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:09 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:09 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f17b56bf-53f5-4ef4-a535-da28b36db2fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.753564 Apr 14 13:15:09 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 66/203] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 13:15:08 2023] GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118/os-interface => generated 1828 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lazy-loading 'services' on Instance uuid 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:15:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b7d6edf1-b188-42c2-98b1-e0b170eecaab tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-volume_attachments/de854352-8b0b-4f27-ad88-9714392f776d" status: 202 len: 0 microversion: 2.49 time: 0.262738 Apr 14 13:15:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 13:15:10 2023] DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-volume_attachments/de854352-8b0b-4f27-ad88-9714392f776d => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "tag": "97d7d320-4ac2-41af-86ca-c30f00808f33"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] Creating event network-changed:97d7d320-4ac2-41af-86ca-c30f00808f33 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-bfabc0e3-c2e7-4466-b824-2d01970c1ca5 req-24554df4-3b30-48e1-b6ec-57d76167765d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031978 Apr 14 13:15:10 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 70/205] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:10 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-1390c49d-65e6-4dc5-a74c-1b6bdfc45dc1 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118" status: 200 len: 2819 microversion: 2.32 time: 0.203181 Apr 14 13:15:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 67/206] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:15:10 2023] GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 => generated 2819 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:11 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b50c5d5b-82bf-47b4-b8e0-c2c293ffab1f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/os-interface" status: 200 len: 1826 microversion: 2.42 time: 0.378559 Apr 14 13:15:11 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 70/207] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 13:15:10 2023] GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/os-interface => generated 1826 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:15:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ee8bb182-5865-4e81-ae91-844c19424dd7 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.449282 Apr 14 13:15:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 71/208] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 13:15:10 2023] GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118/os-interface => generated 1828 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:15:11 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "tag": "4fef6c1f-75be-46b1-b091-f3717d65bb21"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] Creating event network-changed:4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-e228625e-0cb9-4f67-b56a-dcb3427610d4 req-49b212f5-f38b-48fb-8641-b458b773719f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034353 Apr 14 13:15:12 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 68/209] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:12 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d8f7fd41-ff46-4847-8246-ac23c12c71bf tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" status: 200 len: 2825 microversion: 2.42 time: 0.198046 Apr 14 13:15:12 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 71/210] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:15:12 2023] GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => generated 2825 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:15:12 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:12 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:15:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9787f6a4-501e-4578-8875-a4afee5be3b4 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118" status: 204 len: 0 microversion: 2.32 time: 0.151746 Apr 14 13:15:12 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 69/211] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:15:12 2023] DELETE /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e22913a1-a483-424e-8a9d-24d1f7f9ee54 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/os-interface" status: 200 len: 1826 microversion: 2.42 time: 0.520480 Apr 14 13:15:12 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 72/212] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 13:15:12 2023] GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93/os-interface => generated 1826 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-411bc5bb-8489-4b10-95c7-3847554f2749 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-interface/86f24d4d-809a-47a3-9ca5-b45042e95ce8" status: 202 len: 0 microversion: 2.49 time: 0.066175 Apr 14 13:15:12 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 70/213] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 13:15:12 2023] DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-interface/86f24d4d-809a-47a3-9ca5-b45042e95ce8 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-unplugged", "status": "completed", "tag": "97d7d320-4ac2-41af-86ca-c30f00808f33"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] Creating event network-vif-unplugged:97d7d320-4ac2-41af-86ca-c30f00808f33 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-dca9559b-3c5d-416e-ae48-b71c09f3cda1 req-73d43bbc-b463-4edf-b253-7853608b5f63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064784 Apr 14 13:15:13 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 71/214] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-unplugged", "status": "completed", "tag": "089a686b-763d-41df-b624-291933367593"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] Creating event network-vif-unplugged:089a686b-763d-41df-b624-291933367593 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:13 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-201c81c9-d8f5-4e6d-a033-960669bcbccd tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-instance-actions/req-411bc5bb-8489-4b10-95c7-3847554f2749" status: 200 len: 474 microversion: 2.49 time: 0.320543 Apr 14 13:15:13 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 73/215] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 13:15:12 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-instance-actions/req-411bc5bb-8489-4b10-95c7-3847554f2749 => generated 474 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 13:15:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-b3611e72-3229-465d-a547-06975ce1a057 req-7440ab4f-d3ca-44c9-8077-24b535a5ce0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044377 Apr 14 13:15:13 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 72/216] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-5714271e-2e83-49bf-8da5-5c1923df20ad tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073699 Apr 14 13:15:13 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 74/217] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:13 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-16c91c59-0d2c-4244-9041-9ce63f3bd245 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054764 Apr 14 13:15:13 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:13 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "3ddfd1c1-8f03-4f07-a754-304e70750e92"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:13 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-77aee01b-b372-4da2-b85e-f796746f65b9 tempest-TestVolumeSwap-1107548369 tempest-TestVolumeSwap-1107548369-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments/3bfe6502-3c9d-4714-a244-31792062ae86" status: 202 len: 0 microversion: 2.1 time: 0.345562 Apr 14 13:15:13 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 75/219] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 13:15:13 2023] PUT /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments/3bfe6502-3c9d-4714-a244-31792062ae86 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:15:13 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:13 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:13 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e7115dcde1a6480e9e2db9cb8d4fdad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b68596374d4b918a83f403f2f25143', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b91fdac2-c72d-4cf9-aa07-692b12cd68fa tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118" status: 200 len: 2944 microversion: 2.32 time: 1.198984 Apr 14 13:15:13 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 72/220] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:15:12 2023] GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 => generated 2944 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-unplugged", "status": "completed", "tag": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-unplugged", "status": "completed", "tag": "c2904a0c-904d-4dc3-9ffc-aaa05e253319"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Creating event network-vif-unplugged:1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Creating event network-vif-plugged:1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] Creating event network-vif-unplugged:c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-19e2c30b-3fc3-407b-8bec-8c07c45c142e req-d6dc01f9-e8d4-4429-bc5b-70c34a580e42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.089540 Apr 14 13:15:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 74/221] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:14 2023] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:15:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-cc3b7730-58a7-4f09-abfe-00b11a5f4192 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" status: 204 len: 0 microversion: 2.42 time: 0.150471 Apr 14 13:15:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 76/222] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:15:14 2023] DELETE /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:14 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '213b7b010b7f40b0946ec1575216e80d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16235c48e6fb4457bbd7edfa321929a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-12b4fb0f-92aa-435e-89de-c80e100b2516 tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" status: 200 len: 2950 microversion: 2.42 time: 0.265066 Apr 14 13:15:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 73/223] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:15:14 2023] GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => generated 2950 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:15:15 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:15 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-79b376fd-9e9e-4862-a939-1f2f929643ff tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f" status: 200 len: 1489 microversion: 2.1 time: 0.343493 Apr 14 13:15:15 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 75/224] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:14 2023] GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f => generated 1489 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:15 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "97d7d320-4ac2-41af-86ca-c30f00808f33"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-unplugged", "status": "completed", "tag": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-unplugged", "status": "completed", "tag": "8a4f2864-33fc-4666-bb51-bdd01bc07af4"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "8a4f2864-33fc-4666-bb51-bdd01bc07af4"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:15 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "089a686b-763d-41df-b624-291933367593"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-unplugged", "status": "completed", "tag": "96beb287-2181-4df4-b835-a9f071ace5df"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "96beb287-2181-4df4-b835-a9f071ace5df"}, {"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-deleted", "tag": "86f24d4d-809a-47a3-9ca5-b45042e95ce8"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-unplugged", "status": "completed", "tag": "4fef6c1f-75be-46b1-b091-f3717d65bb21"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Creating event network-vif-plugged:97d7d320-4ac2-41af-86ca-c30f00808f33 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Creating event network-vif-unplugged:ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Creating event network-vif-plugged:ec4f98b7-b1a8-4d40-a036-75a4c71f8c5a for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Creating event network-vif-unplugged:8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] Creating event network-vif-plugged:8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Creating event network-vif-plugged:089a686b-763d-41df-b624-291933367593 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Creating event network-vif-unplugged:96beb287-2181-4df4-b835-a9f071ace5df for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Creating event network-vif-plugged:96beb287-2181-4df4-b835-a9f071ace5df for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Creating event network-vif-deleted:86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:15:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] Creating event network-vif-unplugged:4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-4d6ef034-99cb-43ef-b749-712535b2b228 req-3599fed9-73bc-48c6-8a8e-035d04336f27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.073978 Apr 14 13:15:15 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 77/225] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:15 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-0bb67994-a244-4ef1-be1a-5b7323546d91 req-542726a4-06da-4af1-a3c7-b7d7e9467ac3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.063155 Apr 14 13:15:15 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 74/226] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:15 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:16 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-plugged", "status": "completed", "tag": "c2904a0c-904d-4dc3-9ffc-aaa05e253319"}, {"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-unplugged", "status": "completed", "tag": "86f24d4d-809a-47a3-9ca5-b45042e95ce8"}, {"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-plugged", "status": "completed", "tag": "86f24d4d-809a-47a3-9ca5-b45042e95ce8"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-unplugged", "status": "completed", "tag": "3532d3d6-73ac-40eb-9486-d70fac78c992"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3532d3d6-73ac-40eb-9486-d70fac78c992"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-unplugged", "status": "completed", "tag": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Creating event network-vif-plugged:c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Creating event network-vif-unplugged:86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:15:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Creating event network-vif-plugged:86f24d4d-809a-47a3-9ca5-b45042e95ce8 for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:15:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Creating event network-vif-unplugged:3532d3d6-73ac-40eb-9486-d70fac78c992 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Creating event network-vif-plugged:3532d3d6-73ac-40eb-9486-d70fac78c992 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Creating event network-vif-unplugged:3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] Creating event network-vif-plugged:3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f3a88e6e-2533-49d2-9da2-8b8b78555120 req-aa7ae2ae-8b5c-4484-9f32-422993d6c93e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.063729 Apr 14 13:15:16 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 76/227] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 13:15:16 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-unplugged", "status": "completed", "tag": "8e63fe4d-bc87-40cb-855e-ad82726ca39d"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "8e63fe4d-bc87-40cb-855e-ad82726ca39d"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:17 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "4fef6c1f-75be-46b1-b091-f3717d65bb21"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-unplugged", "status": "completed", "tag": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "3929e20e-3bcb-4e87-bbb3-59f52e6e7047"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-unplugged", "status": "completed", "tag": "64455602-0478-47d7-9d50-551d552ceb26"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "64455602-0478-47d7-9d50-551d552ceb26"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-unplugged", "status": "completed", "tag": "ff64a492-8e97-4c11-9207-bf56011d8a5d"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-plugged", "status": "completed", "tag": "ff64a492-8e97-4c11-9207-bf56011d8a5d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Creating event network-vif-unplugged:8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] Creating event network-vif-plugged:8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-7b8d9d72-c5c2-4317-9e2e-e5e54252facc req-f0dde1ae-e9b6-4ecc-82e6-ed7a8c359ba7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032860 Apr 14 13:15:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 78/228] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:17 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Creating event network-vif-plugged:4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Creating event network-vif-unplugged:3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Creating event network-vif-plugged:3929e20e-3bcb-4e87-bbb3-59f52e6e7047 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Creating event network-vif-unplugged:64455602-0478-47d7-9d50-551d552ceb26 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Creating event network-vif-plugged:64455602-0478-47d7-9d50-551d552ceb26 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Creating event network-vif-unplugged:ff64a492-8e97-4c11-9207-bf56011d8a5d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] Creating event network-vif-plugged:ff64a492-8e97-4c11-9207-bf56011d8a5d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-711c9691-7053-4028-b51d-33d8c17a104a req-532e2447-f0c0-47aa-b9e5-37408b232e7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.036587 Apr 14 13:15:17 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 75/229] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 13:15:17 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] HTTP exception thrown: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Request method failure captured: Apr 14 13:15:18 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd HTTP/1.1 Apr 14 13:15:18 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:15:18 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:15:18 user devstack@n-api.service[61776]: Connection: close Apr 14 13:15:18 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:15:18 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:15:18 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:15:18 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:15:18 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE4_HF6n7VK0OoNbopknKdPzy7assCgnWLdwUx0PvaxfPN3QDZAHge_94ixXsQJuGTgUuS0MRWFMyu2wj7o7qW8I1by3eDuGIXDr5V-KqlgTwe1P6JPmII4HkcC-FBvBEaLkdtWE6kzUG_cOPpR9EeF6whgWTFhP3AIpuFj4yWnnzs Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Project-Id: 50d534e4c1cd4abb9204ce53e9a2a7b3 Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Project-Name: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Tenant: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Tenant-Id: 50d534e4c1cd4abb9204ce53e9a2a7b3 Apr 14 13:15:18 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:18 user devstack@n-api.service[61776]: X-User: tempest-DeleteServersTestJSON-1521801319-project-member Apr 14 13:15:18 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:15:18 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:15:18 user devstack@n-api.service[61776]: X-User-Id: 152f7a419a524915a216130426b32ea4 Apr 14 13:15:18 user devstack@n-api.service[61776]: X-User-Name: tempest-DeleteServersTestJSON-1521801319-project-member Apr 14 13:15:18 user devstack@n-api.service[61776]: method: > Apr 14 13:15:18 user devstack@n-api.service[61776]: exception: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61776]: action_args: {'id': '62e10eb2-a042-4916-8b61-51f7dcd731dd'} Apr 14 13:15:18 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Returning 404 to user: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:15:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d58bba3d-994b-46fc-834b-e15c1c8e313e tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd" status: 404 len: 111 microversion: 2.1 time: 0.033247 Apr 14 13:15:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 77/230] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:18 2023] GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] HTTP exception thrown: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Request method failure captured: Apr 14 13:15:18 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd/os-volume_attachments HTTP/1.1 Apr 14 13:15:18 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:15:18 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:15:18 user devstack@n-api.service[61774]: Connection: close Apr 14 13:15:18 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:15:18 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:15:18 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:15:18 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:15:18 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE4_HF6n7VK0OoNbopknKdPzy7assCgnWLdwUx0PvaxfPN3QDZAHge_94ixXsQJuGTgUuS0MRWFMyu2wj7o7qW8I1by3eDuGIXDr5V-KqlgTwe1P6JPmII4HkcC-FBvBEaLkdtWE6kzUG_cOPpR9EeF6whgWTFhP3AIpuFj4yWnnzs Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Project-Id: 50d534e4c1cd4abb9204ce53e9a2a7b3 Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Project-Name: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Tenant: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Tenant-Id: 50d534e4c1cd4abb9204ce53e9a2a7b3 Apr 14 13:15:18 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:18 user devstack@n-api.service[61774]: X-User: tempest-DeleteServersTestJSON-1521801319-project-member Apr 14 13:15:18 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:15:18 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:15:18 user devstack@n-api.service[61774]: X-User-Id: 152f7a419a524915a216130426b32ea4 Apr 14 13:15:18 user devstack@n-api.service[61774]: X-User-Name: tempest-DeleteServersTestJSON-1521801319-project-member Apr 14 13:15:18 user devstack@n-api.service[61774]: method: > Apr 14 13:15:18 user devstack@n-api.service[61774]: exception: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61774]: action_args: {'server_id': '62e10eb2-a042-4916-8b61-51f7dcd731dd'} Apr 14 13:15:18 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:18 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Returning 404 to user: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:15:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1a3d16bc-ddc5-440d-b64b-3135255b4ba8 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042531 Apr 14 13:15:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:18 2023] GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:15:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-deleted", "tag": "1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] Creating event network-vif-deleted:1d62e14d-6cc8-4fc4-bb99-e3bd5be033bf for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-5dbccb70-b4cc-44c8-a482-68acad110377 req-c622e1b2-6dae-4395-9d86-7c570089133d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044561 Apr 14 13:15:19 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 76/232] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e44d6c87-c538-4b1d-8c84-d5f47ff94010 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1688 microversion: 2.1 time: 0.283207 Apr 14 13:15:21 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 78/233] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:20 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1688 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:21 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-deleted", "tag": "97d7d320-4ac2-41af-86ca-c30f00808f33"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-deleted", "tag": "c2904a0c-904d-4dc3-9ffc-aaa05e253319"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] Creating event network-vif-deleted:97d7d320-4ac2-41af-86ca-c30f00808f33 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] Creating event network-vif-deleted:c2904a0c-904d-4dc3-9ffc-aaa05e253319 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-1615e0eb-b430-4f8c-a7cc-5e321fa4993a req-f633a429-97db-4e4e-a691-0ce8bd8a671a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056709 Apr 14 13:15:21 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:21 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] HTTP exception thrown: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Request method failure captured: Apr 14 13:15:21 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd HTTP/1.1 Apr 14 13:15:21 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:15:21 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:15:21 user devstack@n-api.service[61774]: Connection: close Apr 14 13:15:21 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:15:21 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:15:21 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:15:21 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:15:21 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE4_HF6n7VK0OoNbopknKdPzy7assCgnWLdwUx0PvaxfPN3QDZAHge_94ixXsQJuGTgUuS0MRWFMyu2wj7o7qW8I1by3eDuGIXDr5V-KqlgTwe1P6JPmII4HkcC-FBvBEaLkdtWE6kzUG_cOPpR9EeF6whgWTFhP3AIpuFj4yWnnzs Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Project-Id: 50d534e4c1cd4abb9204ce53e9a2a7b3 Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Project-Name: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Tenant: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Tenant-Id: 50d534e4c1cd4abb9204ce53e9a2a7b3 Apr 14 13:15:21 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:21 user devstack@n-api.service[61774]: X-User: tempest-DeleteServersTestJSON-1521801319-project-member Apr 14 13:15:21 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:15:21 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:15:21 user devstack@n-api.service[61774]: X-User-Id: 152f7a419a524915a216130426b32ea4 Apr 14 13:15:21 user devstack@n-api.service[61774]: X-User-Name: tempest-DeleteServersTestJSON-1521801319-project-member Apr 14 13:15:21 user devstack@n-api.service[61774]: method: > Apr 14 13:15:21 user devstack@n-api.service[61774]: exception: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61774]: action_args: {'id': '62e10eb2-a042-4916-8b61-51f7dcd731dd'} Apr 14 13:15:21 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Returning 404 to user: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:15:21 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-86ec34e0-c674-4d73-8b8c-d90a21b3c045 tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd" status: 404 len: 111 microversion: 2.1 time: 0.135042 Apr 14 13:15:21 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 80/235] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:15:21 2023] DELETE /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] [instance: 62e10eb2-a042-4916-8b61-51f7dcd731dd] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] HTTP exception thrown: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Request method failure captured: Apr 14 13:15:21 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd HTTP/1.1 Apr 14 13:15:21 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:15:21 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:15:21 user devstack@n-api.service[61776]: Connection: close Apr 14 13:15:21 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:15:21 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:15:21 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:15:21 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:15:21 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE4_HF6n7VK0OoNbopknKdPzy7assCgnWLdwUx0PvaxfPN3QDZAHge_94ixXsQJuGTgUuS0MRWFMyu2wj7o7qW8I1by3eDuGIXDr5V-KqlgTwe1P6JPmII4HkcC-FBvBEaLkdtWE6kzUG_cOPpR9EeF6whgWTFhP3AIpuFj4yWnnzs Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Project-Id: 50d534e4c1cd4abb9204ce53e9a2a7b3 Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Project-Name: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/50d534e4c1cd4abb9204ce53e9a2a7b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Tenant: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Tenant-Id: 50d534e4c1cd4abb9204ce53e9a2a7b3 Apr 14 13:15:21 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-DeleteServersTestJSON-1521801319 Apr 14 13:15:21 user devstack@n-api.service[61776]: X-User: tempest-DeleteServersTestJSON-1521801319-project-member Apr 14 13:15:21 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:15:21 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:15:21 user devstack@n-api.service[61776]: X-User-Id: 152f7a419a524915a216130426b32ea4 Apr 14 13:15:21 user devstack@n-api.service[61776]: X-User-Name: tempest-DeleteServersTestJSON-1521801319-project-member Apr 14 13:15:21 user devstack@n-api.service[61776]: method: > Apr 14 13:15:21 user devstack@n-api.service[61776]: exception: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61776]: action_args: {'id': '62e10eb2-a042-4916-8b61-51f7dcd731dd'} Apr 14 13:15:21 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. Apr 14 13:15:21 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] Returning 404 to user: Instance 62e10eb2-a042-4916-8b61-51f7dcd731dd could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:15:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2000e7ee-dcb3-4c1f-a429-f8032afe2cbb tempest-DeleteServersTestJSON-1521801319 tempest-DeleteServersTestJSON-1521801319-project-member] 10.0.0.210 "GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd" status: 404 len: 111 microversion: 2.1 time: 0.071747 Apr 14 13:15:21 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 79/236] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:21 2023] GET /compute/v2.1/servers/62e10eb2-a042-4916-8b61-51f7dcd731dd => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:15:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-deleted", "tag": "64455602-0478-47d7-9d50-551d552ceb26"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-deleted", "tag": "96beb287-2181-4df4-b835-a9f071ace5df"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-deleted", "tag": "3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21"}, {"server_uuid": "7cf6ed7d-a98e-4984-967c-148e1537a118", "name": "network-vif-deleted", "tag": "8a4f2864-33fc-4666-bb51-bdd01bc07af4"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-deleted", "tag": "ff64a492-8e97-4c11-9207-bf56011d8a5d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Creating event network-vif-deleted:64455602-0478-47d7-9d50-551d552ceb26 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Creating event network-vif-deleted:96beb287-2181-4df4-b835-a9f071ace5df for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Creating event network-vif-deleted:3c3adf3c-41b0-4663-8ee9-fa3f9ae4af21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Creating event network-vif-deleted:8a4f2864-33fc-4666-bb51-bdd01bc07af4 for instance 7cf6ed7d-a98e-4984-967c-148e1537a118 on user Apr 14 13:15:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] Creating event network-vif-deleted:ff64a492-8e97-4c11-9207-bf56011d8a5d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-19748c69-0d6d-4cf9-91fc-0248e05d6d5f req-ef5acf73-3d32-475c-abf9-6f5855d15e62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.056547 Apr 14 13:15:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 78/237] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:23 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecf06e30-17dc-45c5-9fb1-5db1599ef12d", "device": "/dev/vdb"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-63ed58eb-9eec-4d96-b3cb-653f8dd43131 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "POST /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.550202 Apr 14 13:15:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 81/238] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:15:24 2023] POST /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/os-volume_attachments => generated 194 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:25 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-deleted", "tag": "4fef6c1f-75be-46b1-b091-f3717d65bb21"}, {"server_uuid": "7c9e3e27-e027-4e14-84a2-23ae2e5b1b93", "name": "network-vif-deleted", "tag": "8e63fe4d-bc87-40cb-855e-ad82726ca39d"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] Creating event network-vif-deleted:4fef6c1f-75be-46b1-b091-f3717d65bb21 for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] Creating event network-vif-deleted:8e63fe4d-bc87-40cb-855e-ad82726ca39d for instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 on user Apr 14 13:15:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-2c6f8d81-dce1-4d00-8ccc-d5ef1ad7003e req-8fa93427-405a-4259-b81e-8163ef246889 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040673 Apr 14 13:15:26 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 80/239] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:25 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:27 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:27 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b8981b52-9c82-423b-8899-0602dc1d91a0 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 Apr 14 13:15:27 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 79/240] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:27 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:27 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:27 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:27 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9851b0d6-094b-4f1e-a066-eac4ebb36809 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048260 Apr 14 13:15:27 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 82/241] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:27 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:27 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:27 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:28 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lazy-loading 'services' on Instance uuid 990b083b-744a-42cb-88f3-7ae16a5abed4 {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:15:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-216fd7fe-b912-4316-8072-b3029e690d5f tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments/3ddfd1c1-8f03-4f07-a754-304e70750e92" status: 202 len: 0 microversion: 2.1 time: 0.186306 Apr 14 13:15:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:15:27 2023] DELETE /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments/3ddfd1c1-8f03-4f07-a754-304e70750e92 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:15:28 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:28 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:28 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9f2826f8-1645-466f-9952-fbb93b4cf437 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061653 Apr 14 13:15:28 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 80/243] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:28 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:34 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d3756fc8-afde-4736-b5f0-3e1a2c090d74 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Action: 'create', calling method: .version_select at 0x7fa743c23be0>, body: {"keypair": {"name": "tempest-keypair-1253237269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjseCXo591Ib7m2QQg2YUiEmBpT41KO6pBZujMk3kb1ezcLxBJnhodHUloea6z3H0OhTIU/PPnS5Viw3M1jYSulnA0hMkrnmWEGu58Pu2ctSWI3CS0ih18sa0sVBubY/Q=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:34 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:34 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-d3756fc8-afde-4736-b5f0-3e1a2c090d74 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Getting quotas for project 76b733f664b340e289c562e19ebd28c3. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:15:34 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-d3756fc8-afde-4736-b5f0-3e1a2c090d74 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Getting quotas for user 065f23d461f44751a6911adcd3124fe9 and project 76b733f664b340e289c562e19ebd28c3. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:15:34 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a99de7de-30ee-47e4-acc3-7481760645f9 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372" status: 200 len: 1543 microversion: 2.1 time: 0.399501 Apr 14 13:15:34 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 83/244] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:34 2023] GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 => generated 1543 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:34 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d3756fc8-afde-4736-b5f0-3e1a2c090d74 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.304817 Apr 14 13:15:34 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 82/245] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:15:34 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:36 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-450055877", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "1791e209-7b0c-4262-a342-ed1523633f77"}], "security_groups": [{"name": "tempest-securitygroup--622588352"}], "key_name": "tempest-keypair-1253237269", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:36 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] validate_networks() for [('1791e209-7b0c-4262-a342-ed1523633f77', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: e058f6b1-e83b-49af-9ab3-a29b959f211f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Getting quotas for project 76b733f664b340e289c562e19ebd28c3. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Getting quotas for user 065f23d461f44751a6911adcd3124fe9 and project 76b733f664b340e289c562e19ebd28c3. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:15:37 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] HTTP exception thrown: Instance e058f6b1-e83b-49af-9ab3-a29b959f211f could not be found. Apr 14 13:15:37 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Request method failure captured: Apr 14 13:15:37 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f HTTP/1.1 Apr 14 13:15:37 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:15:37 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:15:37 user devstack@n-api.service[61774]: Connection: close Apr 14 13:15:37 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:15:37 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:15:37 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:15:37 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:15:37 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVFR7VGYIQ3yiZFvrtFnkVIi3EyGSpyRZkN5YVWMGRjqbtHwBDNp6lC0xEqDYVqJ60JU3GwVqmn_wFYGKg579XcoU0lKfm0j6bjvFT-nVTQCXYHbJDawa8R3gBA4nrm8SkRobOKWsdFrz7bXIG3dj61jqX0AMFk1hxBfggCGueLN9hI Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Project-Id: e1c7d361867b4265bd4e1d13e9e66bc4 Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Project-Name: tempest-VolumesActionsTest-2125520108 Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e1c7d361867b4265bd4e1d13e9e66bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1c7d361867b4265bd4e1d13e9e66bc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1c7d361867b4265bd4e1d13e9e66bc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Tenant: tempest-VolumesActionsTest-2125520108 Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Tenant-Id: e1c7d361867b4265bd4e1d13e9e66bc4 Apr 14 13:15:37 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-VolumesActionsTest-2125520108 Apr 14 13:15:37 user devstack@n-api.service[61774]: X-User: tempest-VolumesActionsTest-2125520108-project-member Apr 14 13:15:37 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:15:37 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:15:37 user devstack@n-api.service[61774]: X-User-Id: 1c4166b50a7c49158acc8684eaee6041 Apr 14 13:15:37 user devstack@n-api.service[61774]: X-User-Name: tempest-VolumesActionsTest-2125520108-project-member Apr 14 13:15:37 user devstack@n-api.service[61774]: method: > Apr 14 13:15:37 user devstack@n-api.service[61774]: exception: Instance e058f6b1-e83b-49af-9ab3-a29b959f211f could not be found. Apr 14 13:15:37 user devstack@n-api.service[61774]: action_args: {'id': 'e058f6b1-e83b-49af-9ab3-a29b959f211f'} Apr 14 13:15:37 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e058f6b1-e83b-49af-9ab3-a29b959f211f could not be found. Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e058f6b1-e83b-49af-9ab3-a29b959f211f could not be found. Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e058f6b1-e83b-49af-9ab3-a29b959f211f could not be found. Apr 14 13:15:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Returning 404 to user: Instance e058f6b1-e83b-49af-9ab3-a29b959f211f could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:15:37 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-81567921-14ce-4187-be75-1f6a86aa5afa tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f" status: 404 len: 111 microversion: 2.1 time: 0.056024 Apr 14 13:15:37 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 84/246] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:37 2023] GET /compute/v2.1/servers/e058f6b1-e83b-49af-9ab3-a29b959f211f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:15:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d2031900-800b-481f-8b44-edeec4e377de tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.740370 Apr 14 13:15:37 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 81/247] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:15:36 2023] POST /compute/v2.1/servers => generated 403 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:15:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5fabd5c0-b741-4afc-94ef-d1a3761bc151 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:37 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5fabd5c0-b741-4afc-94ef-d1a3761bc151 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1313042541", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "c6dfe7b8-e16e-4c31-93b7-9e358f72de7a"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:37 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-5fabd5c0-b741-4afc-94ef-d1a3761bc151 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065f23d461f44751a6911adcd3124fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b733f664b340e289c562e19ebd28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-5fabd5c0-b741-4afc-94ef-d1a3761bc151 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 200 len: 1239 microversion: 2.1 time: 0.069254 Apr 14 13:15:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 83/248] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:37 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:37 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] validate_networks() for [('c6dfe7b8-e16e-4c31-93b7-9e358f72de7a', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Getting quotas for project e1c7d361867b4265bd4e1d13e9e66bc4. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Getting quotas for user 1c4166b50a7c49158acc8684eaee6041 and project e1c7d361867b4265bd4e1d13e9e66bc4. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:15:38 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:15:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-25154aa0-c8a1-4d14-b9da-a5240d46b731 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.646223 Apr 14 13:15:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 85/249] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:15:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:15:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c0abf453-d6d4-4524-979b-a1b470d7ea01 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:38 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c0abf453-d6d4-4524-979b-a1b470d7ea01 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:38 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-c0abf453-d6d4-4524-979b-a1b470d7ea01 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4166b50a7c49158acc8684eaee6041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7d361867b4265bd4e1d13e9e66bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-c0abf453-d6d4-4524-979b-a1b470d7ea01 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655" status: 200 len: 1208 microversion: 2.1 time: 0.084113 Apr 14 13:15:38 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 82/250] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:38 2023] GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655 => generated 1208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:41 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:41 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:41 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] Creating event network-changed:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:15:41 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-6d4bdcff-5dfc-436c-af73-ac56080a1f0a req-679ff8c9-c3c2-4325-8722-4bb3636aa29d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052891 Apr 14 13:15:41 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 84/251] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb40ccf2-2c37-46ff-be3d-242dc69d0655", "tag": "8cb2e08e-e795-4c9f-ac2c-e249116ef595"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] Creating event network-changed:8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 on user Apr 14 13:15:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-a33fc2e0-c54f-4b71-9f90-a6824105ea61 req-827b4fc0-70e7-42fa-80e9-db50a07ac8e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043682 Apr 14 13:15:43 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 86/252] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:43 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:15:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-4498ee46-5694-4dac-92e3-48084f0312e7 req-356644f6-37b9-4dd7-bec0-d95d23704e5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036535 Apr 14 13:15:43 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 83/253] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:45 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb40ccf2-2c37-46ff-be3d-242dc69d0655", "name": "network-vif-plugged", "status": "completed", "tag": "8cb2e08e-e795-4c9f-ac2c-e249116ef595"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] Creating event network-vif-plugged:8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 on user Apr 14 13:15:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-344ba26a-b5b8-4541-94cd-c22c6b3a4e25 req-031853b4-e991-4260-82f4-c62608ca402b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040544 Apr 14 13:15:45 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 85/254] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:45 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:45 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:15:45 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-0158e060-8926-4df4-97e0-046ca2791b57 req-26759904-d9f0-4310-b111-6fc7026fd427 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061794 Apr 14 13:15:45 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 87/255] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb40ccf2-2c37-46ff-be3d-242dc69d0655", "name": "network-vif-plugged", "status": "completed", "tag": "8cb2e08e-e795-4c9f-ac2c-e249116ef595"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] Creating event network-vif-plugged:8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 on user Apr 14 13:15:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-d3d8f4d3-cc3d-40ef-b8c8-9a2f570d752c req-b196650b-ab20-4ae4-b303-8a340969cc5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058454 Apr 14 13:15:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 84/256] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:48 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c8889f8e-1b06-44cd-9f42-f2c07002a976 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053384 Apr 14 13:15:48 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 86/257] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:15:48 2023] GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-652713944", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "ac0fadd7-d406-42a9-84c3-72fcfa33dc58"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] validate_networks() for [('ac0fadd7-d406-42a9-84c3-72fcfa33dc58', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting quotas for project 9094bc9720194f02abdc6d0b081c7e32. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Getting quotas for user f1387c0adbe74072b52886ddc2af4182 and project 9094bc9720194f02abdc6d0b081c7e32. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:15:49 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:15:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ba4df1b5-b477-4c62-b00e-59e0937599a8 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.673293 Apr 14 13:15:49 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 88/258] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:15:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:15:49 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:49 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=8 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:49 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-141ae05d-a204-4208-a48b-4fbff18df0ff tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:49 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-141ae05d-a204-4208-a48b-4fbff18df0ff tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:49 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-141ae05d-a204-4208-a48b-4fbff18df0ff tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1387c0adbe74072b52886ddc2af4182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9094bc9720194f02abdc6d0b081c7e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-141ae05d-a204-4208-a48b-4fbff18df0ff tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302" status: 200 len: 1211 microversion: 2.1 time: 0.073141 Apr 14 13:15:49 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 85/259] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:49 2023] GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302 => generated 1211 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:52 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:52 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] Creating event network-changed:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:15:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f1033db3-7991-4c0c-b832-101d6414f877 req-1e49cc21-dccc-463e-90c1-dc3e7c701405 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032012 Apr 14 13:15:52 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 87/260] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'services' on Instance uuid 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:15:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1a17a684-453a-45de-9f89-6bc445c85952 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/os-volume_attachments/ecf06e30-17dc-45c5-9fb1-5db1599ef12d" status: 202 len: 0 microversion: 2.1 time: 0.263046 Apr 14 13:15:53 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 89/261] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:15:53 2023] DELETE /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5/os-volume_attachments/ecf06e30-17dc-45c5-9fb1-5db1599ef12d => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] HTTP exception thrown: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Request method failure captured: Apr 14 13:15:53 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff HTTP/1.1 Apr 14 13:15:53 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:15:53 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:15:53 user devstack@n-api.service[61776]: Connection: close Apr 14 13:15:53 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:15:53 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:15:53 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:15:53 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:15:53 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVExW3j9TIUr5szrwLHLblDL6r4lApDSqNf3bACD_WozgRgwQCq0J9nDyLO3OIGKNJdCMeUOOekk-UE6dl7EuvFQAfiD9MLr8ft1K2X2Cu9q6g984kB1vvUxvz-iGSpD5bLm0F4gtE-ojs-ZFVgBzaCWzQ8bhqf70gPSh216Ay2pLmw Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Project-Id: c14f43e2f82342ddbdb5c4ceedc96936 Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Tenant-Id: c14f43e2f82342ddbdb5c4ceedc96936 Apr 14 13:15:53 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:53 user devstack@n-api.service[61776]: X-User: tempest-AttachSCSIVolumeTestJSON-167485890-project-member Apr 14 13:15:53 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:15:53 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:15:53 user devstack@n-api.service[61776]: X-User-Id: 3975df3ad6084eee8bca5aedfc61ac95 Apr 14 13:15:53 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-167485890-project-member Apr 14 13:15:53 user devstack@n-api.service[61776]: method: > Apr 14 13:15:53 user devstack@n-api.service[61776]: exception: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:53 user devstack@n-api.service[61776]: action_args: {'id': 'f9b4e51c-b24a-4025-8be1-4294d06c18ff'} Apr 14 13:15:53 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:53 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Returning 404 to user: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:15:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c5ccbc4f-bff3-4d7d-adc1-6c2da0804221 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff" status: 404 len: 111 microversion: 2.1 time: 0.029394 Apr 14 13:15:53 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:53 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:15:53 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-f3eb1d49-b50f-4607-b086-3c31ee3bae55 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '.version_select at 0x7fa743a820e0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-f3eb1d49-b50f-4607-b086-3c31ee3bae55 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829584132" status: 202 len: 0 microversion: 2.1 time: 0.027951 Apr 14 13:15:54 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 90/263] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 13:15:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1829584132 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:15:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-99ff2996-e6bc-4f31-ba39-4fd18eeb577c tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5" status: 204 len: 0 microversion: 2.1 time: 0.142015 Apr 14 13:15:54 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 86/264] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:15:53 2023] DELETE /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:54 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3445d14b0a44fd999bc2fc875c77bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe64d1d65224162b60849eace352cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:15:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-961ff4e6-f3b5-4d9b-93aa-167305deeae2 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5" status: 200 len: 1548 microversion: 2.1 time: 0.409665 Apr 14 13:15:54 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:54 2023] GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => generated 1548 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:15:54 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-plugged", "status": "completed", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:54 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:15:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] Creating event network-vif-plugged:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:15:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-e8ef7683-c095-46ff-9cac-e15956e3e8cb req-204a84a9-dc52-437c-8b39-56df41b71274 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044957 Apr 14 13:15:54 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 91/266] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387e72a2-6fd9-4cd7-ab72-67535fc67fd5", "name": "network-vif-unplugged", "status": "completed", "tag": "dde4f0a3-4573-4f17-aa86-fef9fd14059e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] Creating event network-vif-unplugged:dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 on user Apr 14 13:15:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-50d95919-1613-4b22-b80b-f1a6bb8e0ccc req-79699e16-0c2d-4444-9fda-78e14cef669a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049687 Apr 14 13:15:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 87/267] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-plugged", "status": "completed", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] Creating event network-vif-plugged:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:15:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-9fe3a100-dad8-4cdd-8968-25aef5d403af req-78d7a82d-6c23-4522-9ef3-fb3ac99d21e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037919 Apr 14 13:15:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387e72a2-6fd9-4cd7-ab72-67535fc67fd5", "name": "network-vif-deleted", "tag": "dde4f0a3-4573-4f17-aa86-fef9fd14059e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] Creating event network-vif-deleted:dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 on user Apr 14 13:15:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-821c7df9-529b-48e0-b0e9-3a34c46a14ba req-fafb0c6a-eabe-4595-9dc1-24bf7a8ac48e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047034 Apr 14 13:15:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 92/269] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:58 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] HTTP exception thrown: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Request method failure captured: Apr 14 13:15:58 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff HTTP/1.1 Apr 14 13:15:58 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:15:58 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:15:58 user devstack@n-api.service[61775]: Connection: close Apr 14 13:15:58 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:15:58 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:15:58 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:15:58 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:15:58 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVExW3j9TIUr5szrwLHLblDL6r4lApDSqNf3bACD_WozgRgwQCq0J9nDyLO3OIGKNJdCMeUOOekk-UE6dl7EuvFQAfiD9MLr8ft1K2X2Cu9q6g984kB1vvUxvz-iGSpD5bLm0F4gtE-ojs-ZFVgBzaCWzQ8bhqf70gPSh216Ay2pLmw Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Project-Id: c14f43e2f82342ddbdb5c4ceedc96936 Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Tenant-Id: c14f43e2f82342ddbdb5c4ceedc96936 Apr 14 13:15:58 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:58 user devstack@n-api.service[61775]: X-User: tempest-AttachSCSIVolumeTestJSON-167485890-project-member Apr 14 13:15:58 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:15:58 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:15:58 user devstack@n-api.service[61775]: X-User-Id: 3975df3ad6084eee8bca5aedfc61ac95 Apr 14 13:15:58 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-167485890-project-member Apr 14 13:15:58 user devstack@n-api.service[61775]: method: > Apr 14 13:15:58 user devstack@n-api.service[61775]: exception: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61775]: action_args: {'id': 'f9b4e51c-b24a-4025-8be1-4294d06c18ff'} Apr 14 13:15:58 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Returning 404 to user: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:15:58 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-70b6e374-cadb-460a-82d5-aa94b825fc2d tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff" status: 404 len: 111 microversion: 2.1 time: 0.045442 Apr 14 13:15:58 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 88/270] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:15:58 2023] DELETE /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] [instance: f9b4e51c-b24a-4025-8be1-4294d06c18ff] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] HTTP exception thrown: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Request method failure captured: Apr 14 13:15:58 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff HTTP/1.1 Apr 14 13:15:58 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:15:58 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:15:58 user devstack@n-api.service[61776]: Connection: close Apr 14 13:15:58 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:15:58 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:15:58 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:15:58 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:15:58 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVExW3j9TIUr5szrwLHLblDL6r4lApDSqNf3bACD_WozgRgwQCq0J9nDyLO3OIGKNJdCMeUOOekk-UE6dl7EuvFQAfiD9MLr8ft1K2X2Cu9q6g984kB1vvUxvz-iGSpD5bLm0F4gtE-ojs-ZFVgBzaCWzQ8bhqf70gPSh216Ay2pLmw Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Project-Id: c14f43e2f82342ddbdb5c4ceedc96936 Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c14f43e2f82342ddbdb5c4ceedc96936"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Tenant-Id: c14f43e2f82342ddbdb5c4ceedc96936 Apr 14 13:15:58 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-167485890 Apr 14 13:15:58 user devstack@n-api.service[61776]: X-User: tempest-AttachSCSIVolumeTestJSON-167485890-project-member Apr 14 13:15:58 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:15:58 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:15:58 user devstack@n-api.service[61776]: X-User-Id: 3975df3ad6084eee8bca5aedfc61ac95 Apr 14 13:15:58 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-167485890-project-member Apr 14 13:15:58 user devstack@n-api.service[61776]: method: > Apr 14 13:15:58 user devstack@n-api.service[61776]: exception: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61776]: action_args: {'id': 'f9b4e51c-b24a-4025-8be1-4294d06c18ff'} Apr 14 13:15:58 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. Apr 14 13:15:58 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:15:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] Returning 404 to user: Instance f9b4e51c-b24a-4025-8be1-4294d06c18ff could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:15:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-33d00407-b959-4fb4-b10e-b179b0476541 tempest-AttachSCSIVolumeTestJSON-167485890 tempest-AttachSCSIVolumeTestJSON-167485890-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff" status: 404 len: 111 microversion: 2.1 time: 0.061289 Apr 14 13:15:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:15:58 2023] GET /compute/v2.1/servers/f9b4e51c-b24a-4025-8be1-4294d06c18ff => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:15:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387e72a2-6fd9-4cd7-ab72-67535fc67fd5", "name": "network-vif-plugged", "status": "completed", "tag": "dde4f0a3-4573-4f17-aa86-fef9fd14059e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:15:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:15:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:15:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:15:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] Creating event network-vif-plugged:dde4f0a3-4573-4f17-aa86-fef9fd14059e for instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 on user Apr 14 13:15:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-647e0c90-ecaf-48d9-9b3a-3df9a679f13f req-838d399c-d3f3-48f6-be88-41f80e3aeecd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036349 Apr 14 13:15:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 93/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:15:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-6014e711-eb6a-468f-b3cc-838a41f2a679 tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-instance-actions/req-411bc5bb-8489-4b10-95c7-3847554f2749" status: 200 len: 503 microversion: 2.49 time: 0.092706 Apr 14 13:16:03 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 89/273] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 13:16:03 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-instance-actions/req-411bc5bb-8489-4b10-95c7-3847554f2749 => generated 503 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d20997e5-9bb9-405b-b252-3ca66da1011e tempest-TaggedAttachmentsTest-328321442 tempest-TaggedAttachmentsTest-328321442-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-instance-actions/req-411bc5bb-8489-4b10-95c7-3847554f2749" status: 200 len: 503 microversion: 2.49 time: 0.084846 Apr 14 13:16:03 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 92/274] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 13:16:03 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-instance-actions/req-411bc5bb-8489-4b10-95c7-3847554f2749 => generated 503 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-30f7f2b9-5e98-4497-8c94-e63a8928fcec tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.046867 Apr 14 13:16:03 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 94/275] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 13:16:03 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:16:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-615ac81d-ba63-4afe-93de-c9200819a4be tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7" status: 204 len: 0 microversion: 2.49 time: 0.105786 Apr 14 13:16:03 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 90/276] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:16:03 2023] DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] HTTP exception thrown: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Request method failure captured: Apr 14 13:16:03 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 HTTP/1.1 Apr 14 13:16:03 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:16:03 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:16:03 user devstack@n-api.service[61774]: Connection: close Apr 14 13:16:03 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:16:03 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:16:03 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:16:03 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:16:03 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVEzS2l2sFVC97DswukPLE1GviGg9IlIJH5OJPfEm5nRBWUAkUO9cjNLcqel0LxHfJPL_ryDIy_N07Xxg6LqvTAOOio9bfHjFCyVszxo_mWwY7S1LVQchUWAvMhFVmdzWT8ppHWPd7zpwWc5fVDkBMiVrEwzpMDKb4VHwf2BAG0HkvQ Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Project-Id: c9b68596374d4b918a83f403f2f25143 Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Project-Name: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Tenant: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Tenant-Id: c9b68596374d4b918a83f403f2f25143 Apr 14 13:16:03 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:03 user devstack@n-api.service[61774]: X-User: tempest-TaggedBootDevicesTest-1775550058-project-member Apr 14 13:16:03 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:16:03 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:16:03 user devstack@n-api.service[61774]: X-User-Id: e7115dcde1a6480e9e2db9cb8d4fdad3 Apr 14 13:16:03 user devstack@n-api.service[61774]: X-User-Name: tempest-TaggedBootDevicesTest-1775550058-project-member Apr 14 13:16:03 user devstack@n-api.service[61774]: method: > Apr 14 13:16:03 user devstack@n-api.service[61774]: exception: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:03 user devstack@n-api.service[61774]: action_args: {'id': '7cf6ed7d-a98e-4984-967c-148e1537a118'} Apr 14 13:16:03 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:03 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Returning 404 to user: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-77748bc9-9229-4951-8051-67983e85a7ba tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118" status: 404 len: 111 microversion: 2.32 time: 0.041831 Apr 14 13:16:03 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 95/277] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:16:03 2023] GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-238d2ca7-ca1b-44d3-8e6b-a8f623796c55 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '.version_select at 0x7fa743ba2440>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-238d2ca7-ca1b-44d3-8e6b-a8f623796c55 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451174371" status: 204 len: 0 microversion: 2.32 time: 0.032267 Apr 14 13:16:03 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 91/278] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 13:16:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1451174371 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:16:04 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:04 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:04 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '016ee10024d2449c93d67e0b14f09f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3a7e094618456381891d4532bb3cf2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-18fcb42c-5aa4-49d2-b3a4-05896be89193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7" status: 200 len: 1751 microversion: 2.49 time: 0.480385 Apr 14 13:16:04 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 93/279] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:16:03 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => generated 1751 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:16:04 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-unplugged", "status": "completed", "tag": "0946e034-1e6c-42d6-a8e2-1b24fabc000c"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:04 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] Creating event network-vif-unplugged:0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:16:04 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-a65b19bd-b941-4549-9c51-921754ab373a req-a7be2471-3842-4807-adef-72413e65495a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037621 Apr 14 13:16:04 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 96/280] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:04 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] HTTP exception thrown: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Request method failure captured: Apr 14 13:16:04 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 HTTP/1.1 Apr 14 13:16:04 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:16:04 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:16:04 user devstack@n-api.service[61775]: Connection: close Apr 14 13:16:04 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:16:04 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:16:04 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:16:04 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:16:04 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE7VE2e40PvWtK6QcaqmzXoGgWniqjnkx7ZAbtT7e_EP35WsX6pPkQO8fOVQK6FcBaNDuQqRqzRKIuaIISzeL2wl5q5I3GBQm3ddEO6qP_mbKZcgumwN7dO0nbTFL7itbG-GAK1tl7CWqZ0t-p4Hv0DNZ5qcdgqukx2-VyKjVQsJ7k Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Project-Id: 16235c48e6fb4457bbd7edfa321929a8 Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Tenant-Id: 16235c48e6fb4457bbd7edfa321929a8 Apr 14 13:16:04 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:04 user devstack@n-api.service[61775]: X-User: tempest-TaggedBootDevicesTest_v242-1237683370-project-member Apr 14 13:16:04 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:16:04 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:16:04 user devstack@n-api.service[61775]: X-User-Id: 213b7b010b7f40b0946ec1575216e80d Apr 14 13:16:04 user devstack@n-api.service[61775]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1237683370-project-member Apr 14 13:16:04 user devstack@n-api.service[61775]: method: > Apr 14 13:16:04 user devstack@n-api.service[61775]: exception: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:04 user devstack@n-api.service[61775]: action_args: {'id': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'} Apr 14 13:16:04 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:04 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Returning 404 to user: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:04 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-18999e56-9750-4302-a2b1-76b3864a9d3f tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" status: 404 len: 111 microversion: 2.42 time: 0.033892 Apr 14 13:16:04 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 92/281] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:16:04 2023] GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:04 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-04592275-ccd8-4435-9b1a-9fc26244290d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '.version_select at 0x7fa743c22560>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-04592275-ccd8-4435-9b1a-9fc26244290d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-293654497" status: 204 len: 0 microversion: 2.42 time: 0.026509 Apr 14 13:16:04 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 94/282] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 13:16:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-293654497 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:16:06 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-deleted", "tag": "0946e034-1e6c-42d6-a8e2-1b24fabc000c"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:06 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] Creating event network-vif-deleted:0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:16:06 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-2ed17aa7-fed9-4ec2-a6d5-c4449a1004b8 req-f00e35a4-e741-40df-8a40-904594713a1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037282 Apr 14 13:16:06 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 97/283] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:06 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15df44a4-fc31-4dfa-870d-0dd1db47ccd7", "name": "network-vif-plugged", "status": "completed", "tag": "0946e034-1e6c-42d6-a8e2-1b24fabc000c"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:06 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] Creating event network-vif-plugged:0946e034-1e6c-42d6-a8e2-1b24fabc000c for instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 on user Apr 14 13:16:06 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-0b9a077d-f2ab-466f-904a-cef45525fd9a req-4f3241e5-bfc9-4662-81d1-339ecac4b3b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034137 Apr 14 13:16:06 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 93/284] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:07 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:07 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] HTTP exception thrown: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Request method failure captured: Apr 14 13:16:08 user devstack@n-api.service[61776]: request: DELETE /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 HTTP/1.1 Apr 14 13:16:08 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:16:08 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:16:08 user devstack@n-api.service[61776]: Connection: close Apr 14 13:16:08 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:16:08 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:16:08 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:16:08 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:16:08 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVEzS2l2sFVC97DswukPLE1GviGg9IlIJH5OJPfEm5nRBWUAkUO9cjNLcqel0LxHfJPL_ryDIy_N07Xxg6LqvTAOOio9bfHjFCyVszxo_mWwY7S1LVQchUWAvMhFVmdzWT8ppHWPd7zpwWc5fVDkBMiVrEwzpMDKb4VHwf2BAG0HkvQ Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Project-Id: c9b68596374d4b918a83f403f2f25143 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Project-Name: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Tenant: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Tenant-Id: c9b68596374d4b918a83f403f2f25143 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User: tempest-TaggedBootDevicesTest-1775550058-project-member Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User-Id: e7115dcde1a6480e9e2db9cb8d4fdad3 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User-Name: tempest-TaggedBootDevicesTest-1775550058-project-member Apr 14 13:16:08 user devstack@n-api.service[61776]: method: > Apr 14 13:16:08 user devstack@n-api.service[61776]: exception: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: action_args: {'id': '7cf6ed7d-a98e-4984-967c-148e1537a118'} Apr 14 13:16:08 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Returning 404 to user: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-3a25655b-0734-4d3b-a704-5c8e5e3576ac tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118" status: 404 len: 111 microversion: 2.32 time: 0.045857 Apr 14 13:16:08 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 95/285] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:16:07 2023] DELETE /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] [instance: 7cf6ed7d-a98e-4984-967c-148e1537a118] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] HTTP exception thrown: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Request method failure captured: Apr 14 13:16:08 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 HTTP/1.1 Apr 14 13:16:08 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:16:08 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:16:08 user devstack@n-api.service[61774]: Connection: close Apr 14 13:16:08 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:16:08 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:16:08 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:16:08 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:16:08 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVEzS2l2sFVC97DswukPLE1GviGg9IlIJH5OJPfEm5nRBWUAkUO9cjNLcqel0LxHfJPL_ryDIy_N07Xxg6LqvTAOOio9bfHjFCyVszxo_mWwY7S1LVQchUWAvMhFVmdzWT8ppHWPd7zpwWc5fVDkBMiVrEwzpMDKb4VHwf2BAG0HkvQ Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Project-Id: c9b68596374d4b918a83f403f2f25143 Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Project-Name: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9b68596374d4b918a83f403f2f25143"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Tenant: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Tenant-Id: c9b68596374d4b918a83f403f2f25143 Apr 14 13:16:08 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1775550058 Apr 14 13:16:08 user devstack@n-api.service[61774]: X-User: tempest-TaggedBootDevicesTest-1775550058-project-member Apr 14 13:16:08 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:16:08 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:16:08 user devstack@n-api.service[61774]: X-User-Id: e7115dcde1a6480e9e2db9cb8d4fdad3 Apr 14 13:16:08 user devstack@n-api.service[61774]: X-User-Name: tempest-TaggedBootDevicesTest-1775550058-project-member Apr 14 13:16:08 user devstack@n-api.service[61774]: method: > Apr 14 13:16:08 user devstack@n-api.service[61774]: exception: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61774]: action_args: {'id': '7cf6ed7d-a98e-4984-967c-148e1537a118'} Apr 14 13:16:08 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] Returning 404 to user: Instance 7cf6ed7d-a98e-4984-967c-148e1537a118 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-59799c23-c69c-472d-89fa-3df8a3c97970 tempest-TaggedBootDevicesTest-1775550058 tempest-TaggedBootDevicesTest-1775550058-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118" status: 404 len: 111 microversion: 2.32 time: 0.051595 Apr 14 13:16:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 98/286] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:16:08 2023] GET /compute/v2.1/servers/7cf6ed7d-a98e-4984-967c-148e1537a118 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] HTTP exception thrown: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Request method failure captured: Apr 14 13:16:08 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 HTTP/1.1 Apr 14 13:16:08 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:16:08 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:16:08 user devstack@n-api.service[61775]: Connection: close Apr 14 13:16:08 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:16:08 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:16:08 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:16:08 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:16:08 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE7VE2e40PvWtK6QcaqmzXoGgWniqjnkx7ZAbtT7e_EP35WsX6pPkQO8fOVQK6FcBaNDuQqRqzRKIuaIISzeL2wl5q5I3GBQm3ddEO6qP_mbKZcgumwN7dO0nbTFL7itbG-GAK1tl7CWqZ0t-p4Hv0DNZ5qcdgqukx2-VyKjVQsJ7k Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Project-Id: 16235c48e6fb4457bbd7edfa321929a8 Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Tenant-Id: 16235c48e6fb4457bbd7edfa321929a8 Apr 14 13:16:08 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:08 user devstack@n-api.service[61775]: X-User: tempest-TaggedBootDevicesTest_v242-1237683370-project-member Apr 14 13:16:08 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:16:08 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:16:08 user devstack@n-api.service[61775]: X-User-Id: 213b7b010b7f40b0946ec1575216e80d Apr 14 13:16:08 user devstack@n-api.service[61775]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1237683370-project-member Apr 14 13:16:08 user devstack@n-api.service[61775]: method: > Apr 14 13:16:08 user devstack@n-api.service[61775]: exception: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61775]: action_args: {'id': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'} Apr 14 13:16:08 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Returning 404 to user: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-4cabe106-78e7-4250-97b7-6354583de7dc tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" status: 404 len: 111 microversion: 2.42 time: 0.034432 Apr 14 13:16:08 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 94/287] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:16:08 2023] DELETE /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] [instance: 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] HTTP exception thrown: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Request method failure captured: Apr 14 13:16:08 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 HTTP/1.1 Apr 14 13:16:08 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:16:08 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:16:08 user devstack@n-api.service[61776]: Connection: close Apr 14 13:16:08 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:16:08 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:16:08 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:16:08 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:16:08 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE7VE2e40PvWtK6QcaqmzXoGgWniqjnkx7ZAbtT7e_EP35WsX6pPkQO8fOVQK6FcBaNDuQqRqzRKIuaIISzeL2wl5q5I3GBQm3ddEO6qP_mbKZcgumwN7dO0nbTFL7itbG-GAK1tl7CWqZ0t-p4Hv0DNZ5qcdgqukx2-VyKjVQsJ7k Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Project-Id: 16235c48e6fb4457bbd7edfa321929a8 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/16235c48e6fb4457bbd7edfa321929a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Tenant-Id: 16235c48e6fb4457bbd7edfa321929a8 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1237683370 Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User: tempest-TaggedBootDevicesTest_v242-1237683370-project-member Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User-Id: 213b7b010b7f40b0946ec1575216e80d Apr 14 13:16:08 user devstack@n-api.service[61776]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1237683370-project-member Apr 14 13:16:08 user devstack@n-api.service[61776]: method: > Apr 14 13:16:08 user devstack@n-api.service[61776]: exception: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: action_args: {'id': '7c9e3e27-e027-4e14-84a2-23ae2e5b1b93'} Apr 14 13:16:08 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. Apr 14 13:16:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] Returning 404 to user: Instance 7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-86ea400e-157d-4ac3-9020-d7191785a89d tempest-TaggedBootDevicesTest_v242-1237683370 tempest-TaggedBootDevicesTest_v242-1237683370-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93" status: 404 len: 111 microversion: 2.42 time: 0.030023 Apr 14 13:16:08 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 96/288] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:16:08 2023] GET /compute/v2.1/servers/7c9e3e27-e027-4e14-84a2-23ae2e5b1b93 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:15 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-919ba94d-dbf2-4aa9-a146-51486ca586f3 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 200 len: 1503 microversion: 2.1 time: 0.229301 Apr 14 13:16:15 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 99/289] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:15 2023] GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-4c1bcdef-76a9-4986-8bfa-f979d1c46f13 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053913 Apr 14 13:16:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 95/290] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:16:18 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=43 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:18 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:16:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-893c1f44-1666-4059-8250-7715a0c3e334 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4" status: 204 len: 0 microversion: 2.1 time: 0.203600 Apr 14 13:16:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 97/291] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:16:18 2023] DELETE /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:16:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:18 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:19 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e33a6a8f8f441978437332de5499609', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18dfe057a9f742ceb908883f28463a43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:19 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b2271890-d1f8-4345-b0f0-6d36c8b42240 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4" status: 200 len: 1648 microversion: 2.1 time: 0.330460 Apr 14 13:16:19 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 100/292] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:18 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4 => generated 1648 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:16:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990b083b-744a-42cb-88f3-7ae16a5abed4", "name": "network-vif-unplugged", "status": "completed", "tag": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] Creating event network-vif-unplugged:932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance 990b083b-744a-42cb-88f3-7ae16a5abed4 on user Apr 14 13:16:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-e580b2de-f637-48c2-adb6-f81111065f72 req-0de3356a-f321-4c8a-b3ca-f1202048f2a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033227 Apr 14 13:16:19 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 96/293] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990b083b-744a-42cb-88f3-7ae16a5abed4", "name": "network-vif-plugged", "status": "completed", "tag": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3"}, {"server_uuid": "990b083b-744a-42cb-88f3-7ae16a5abed4", "name": "network-vif-deleted", "tag": "932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Creating event network-vif-plugged:932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance 990b083b-744a-42cb-88f3-7ae16a5abed4 on user Apr 14 13:16:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] Creating event network-vif-deleted:932d0b4b-da11-4ca8-9c4e-4e28ec7b06d3 for instance 990b083b-744a-42cb-88f3-7ae16a5abed4 on user Apr 14 13:16:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-008bdb08-1116-4d71-bb80-f5173c2a836a req-4a32ecc3-35e6-4e46-81aa-9654e1f0daad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034288 Apr 14 13:16:21 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 98/294] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:21 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:21 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Going to try to start instance {{(pid=61774) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 13:16:21 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c937003e-f911-4de7-808c-7957ba710b25 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.077307 Apr 14 13:16:21 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 101/295] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:16:21 2023] POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:21 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-c9235928-8856-4684-9652-4fc7b9e39552 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1697 microversion: 2.1 time: 0.573413 Apr 14 13:16:21 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 97/296] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:21 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1697 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:16:26 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:26 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:16:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-153fcff7-7399-4130-a456-145939af477f req-3951e2e5-c5b5-47a7-a4a9-9b1e37007610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038590 Apr 14 13:16:26 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 99/297] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:27 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:28 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065f23d461f44751a6911adcd3124fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b733f664b340e289c562e19ebd28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-41d0e2b1-56fa-4aac-9a53-66c92b1e1164 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 200 len: 1553 microversion: 2.1 time: 0.350974 Apr 14 13:16:28 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 102/298] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:27 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 1553 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:16:28 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:28 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:16:28 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-702157df-a5e4-480f-ae81-5688b15ccbcf req-0ce6f893-4740-451d-8189-c7301e9efa52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027706 Apr 14 13:16:28 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 98/299] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:28 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4166b50a7c49158acc8684eaee6041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7d361867b4265bd4e1d13e9e66bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-14adb9c9-4172-4c13-b9d7-02b1b5659688 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655" status: 200 len: 1487 microversion: 2.1 time: 0.304084 Apr 14 13:16:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 100/300] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:28 2023] GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655 => generated 1487 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=24 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:35 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7fb942f9-6c0e-446d-bf5f-427d883dba1c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.345414 Apr 14 13:16:35 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 103/301] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:16:34 2023] GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372/os-interface => generated 282 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24179ea7-82e2-48fd-9aab-2e3bf7edb372", "tag": "c1984923-9c3a-400f-9e54-c4bc6b476074"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] Creating event network-changed:c1984923-9c3a-400f-9e54-c4bc6b476074 for instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 on user Apr 14 13:16:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-f0cc1296-a090-4381-a9dd-b560bca8f23a req-256aa2da-555f-4601-bf8f-f0d53ddab140 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042616 Apr 14 13:16:37 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 99/302] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-bece6905-9010-42cf-8ec8-a954d3499232 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372/ips" status: 200 len: 107 microversion: 2.1 time: 0.053107 Apr 14 13:16:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 101/303] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:16:37 2023] GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372/ips => generated 107 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49056810-6abe-48de-b4bd-71d9f5d45096"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Invalid volume: volume 49056810-6abe-48de-b4bd-71d9f5d45096 is already attached to instances: c34d24a3-a632-4f05-b6fb-dc3562dc93d6 Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:16:37 user devstack@n-api.service[61774]: request: POST /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372/os-volume_attachments HTTP/1.1 Apr 14 13:16:37 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:16:37 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:16:37 user devstack@n-api.service[61774]: Connection: close Apr 14 13:16:37 user devstack@n-api.service[61774]: Content-Length: 74 Apr 14 13:16:37 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:16:37 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:16:37 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:16:37 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:16:37 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:16:37 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:16:37 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:16:37 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:16:37 user devstack@n-api.service[61774]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:16:37 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:16:37 user devstack@n-api.service[61774]: Apr 14 13:16:37 user devstack@n-api.service[61774]: {"volumeAttachment": {"volumeId": "49056810-6abe-48de-b4bd-71d9f5d45096"}} Apr 14 13:16:37 user devstack@n-api.service[61774]: method: > Apr 14 13:16:37 user devstack@n-api.service[61774]: exception: Invalid volume: volume 49056810-6abe-48de-b4bd-71d9f5d45096 is already attached to instances: c34d24a3-a632-4f05-b6fb-dc3562dc93d6 Apr 14 13:16:37 user devstack@n-api.service[61774]: action_args: {'server_id': '24179ea7-82e2-48fd-9aab-2e3bf7edb372', 'body': {'volumeAttachment': {'volumeId': '49056810-6abe-48de-b4bd-71d9f5d45096'}}} Apr 14 13:16:37 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 49056810-6abe-48de-b4bd-71d9f5d45096 is already attached to instances: c34d24a3-a632-4f05-b6fb-dc3562dc93d6 Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 49056810-6abe-48de-b4bd-71d9f5d45096 is already attached to instances: c34d24a3-a632-4f05-b6fb-dc3562dc93d6 Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 49056810-6abe-48de-b4bd-71d9f5d45096 is already attached to instances: c34d24a3-a632-4f05-b6fb-dc3562dc93d6 Apr 14 13:16:37 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 400 to user: Invalid volume: volume 49056810-6abe-48de-b4bd-71d9f5d45096 is already attached to instances: c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:37 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c4011216-5241-4887-9e4b-2c4889163b93 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153459 Apr 14 13:16:37 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 104/304] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:16:37 2023] POST /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:16:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-7ad7972b-72c7-46ef-a774-51ad328134c4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372" status: 204 len: 0 microversion: 2.1 time: 0.174165 Apr 14 13:16:37 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 100/305] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:16:37 2023] DELETE /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:37 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-83c91be8-c71f-45c6-a816-edfdb11d41d8 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372" status: 200 len: 1549 microversion: 2.1 time: 0.429815 Apr 14 13:16:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 102/306] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:37 2023] GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 => generated 1549 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:16:39 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24179ea7-82e2-48fd-9aab-2e3bf7edb372", "name": "network-vif-unplugged", "status": "completed", "tag": "c1984923-9c3a-400f-9e54-c4bc6b476074"}, {"server_uuid": "24179ea7-82e2-48fd-9aab-2e3bf7edb372", "name": "network-vif-plugged", "status": "completed", "tag": "c1984923-9c3a-400f-9e54-c4bc6b476074"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Creating event network-vif-unplugged:c1984923-9c3a-400f-9e54-c4bc6b476074 for instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 on user Apr 14 13:16:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] Creating event network-vif-plugged:c1984923-9c3a-400f-9e54-c4bc6b476074 for instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 on user Apr 14 13:16:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-57e6ec37-a992-4c14-b4d5-c3c9d10e2512 req-81e909b1-2d8a-4e34-a803-32eb009b3603 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044640 Apr 14 13:16:39 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 105/307] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:39 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:39 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:40 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-752836267", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "73061151-2d01-43ae-9ac6-841d71c038ba"}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:40 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] validate_networks() for [('73061151-2d01-43ae-9ac6-841d71c038ba', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:16:40 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1387c0adbe74072b52886ddc2af4182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9094bc9720194f02abdc6d0b081c7e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-70c94fd6-655f-41af-a0f0-cebaf4d75e64 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302" status: 200 len: 1495 microversion: 2.1 time: 0.338047 Apr 14 13:16:40 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 103/308] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:39 2023] GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302 => generated 1495 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:16:41 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-aafe5a37-d474-47dd-9c6c-f5c2610db1e7 req-5289c3e0-98ed-4968-a6e8-c03eb9ac1ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24179ea7-82e2-48fd-9aab-2e3bf7edb372", "name": "network-vif-deleted", "tag": "c1984923-9c3a-400f-9e54-c4bc6b476074"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aafe5a37-d474-47dd-9c6c-f5c2610db1e7 req-5289c3e0-98ed-4968-a6e8-c03eb9ac1ed0 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aafe5a37-d474-47dd-9c6c-f5c2610db1e7 req-5289c3e0-98ed-4968-a6e8-c03eb9ac1ed0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aafe5a37-d474-47dd-9c6c-f5c2610db1e7 req-5289c3e0-98ed-4968-a6e8-c03eb9ac1ed0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-aafe5a37-d474-47dd-9c6c-f5c2610db1e7 req-5289c3e0-98ed-4968-a6e8-c03eb9ac1ed0 service nova] Creating event network-vif-deleted:c1984923-9c3a-400f-9e54-c4bc6b476074 for instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 on user Apr 14 13:16:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-aafe5a37-d474-47dd-9c6c-f5c2610db1e7 req-5289c3e0-98ed-4968-a6e8-c03eb9ac1ed0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031436 Apr 14 13:16:41 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 106/309] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Getting quotas for project d4b4e44c0b8945079de567503aab3a12. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Getting quotas for user 3f713f95191542f6a23ee25669061b27 and project d4b4e44c0b8945079de567503aab3a12. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:16:41 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:16:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-cb20b4b6-d0cf-4ce0-b8b5-ab80c1b32824 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.244598 Apr 14 13:16:41 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 101/310] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:16:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:16:41 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b8337517-fe2f-4eb5-8387-0df84a683fb8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:41 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-b8337517-fe2f-4eb5-8387-0df84a683fb8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:41 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-b8337517-fe2f-4eb5-8387-0df84a683fb8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:41 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-b8337517-fe2f-4eb5-8387-0df84a683fb8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 200 len: 1210 microversion: 2.1 time: 0.070818 Apr 14 13:16:41 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 104/311] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:41 2023] GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 1210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1191459632", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] validate_networks() for [('5bb34665-b8a7-4eb1-a250-c5b7ca33f499', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting quotas for project a573d19b775642bba2f2883e0005492d. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting quotas for user ebc2d46bc1794568841df20b046356c7 and project a573d19b775642bba2f2883e0005492d. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:16:42 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:16:42 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-4148ec40-03d4-420f-ad86-532d7f8ee1ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.844250 Apr 14 13:16:42 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 107/312] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 13:16:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:16:42 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3eb903b0-fd17-4356-9f07-bb29bedbc3e2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:42 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-3eb903b0-fd17-4356-9f07-bb29bedbc3e2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:42 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-3eb903b0-fd17-4356-9f07-bb29bedbc3e2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:42 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-3eb903b0-fd17-4356-9f07-bb29bedbc3e2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:42 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-3eb903b0-fd17-4356-9f07-bb29bedbc3e2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3eb903b0-fd17-4356-9f07-bb29bedbc3e2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906" status: 200 len: 1395 microversion: 2.87 time: 0.083901 Apr 14 13:16:42 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 102/313] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:16:42 2023] GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906 => generated 1395 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 387e72a2-6fd9-4cd7-ab72-67535fc67fd5] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] HTTP exception thrown: Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 could not be found. Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Request method failure captured: Apr 14 13:16:44 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5 HTTP/1.1 Apr 14 13:16:44 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:16:44 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:16:44 user devstack@n-api.service[61776]: Connection: close Apr 14 13:16:44 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:16:44 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:16:44 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:16:44 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:16:44 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVF1Ko7briIYDDINOI3S39KFh0nutIq4dMFgHRsQz_pegxJxOHqgyWRnx2xL_w_Nm5dTJS1pYitFcOB0brfKBmVoJ9Nq90tD2Mzk22yJqVulYlKmaHcfJ4IertbMQbJplgwUzeHNC9sXaifRFSEcNCzHg0p-bam6yME-MEN7ctKZ3AY Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Project-Id: 4fe64d1d65224162b60849eace352cb4 Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1137775211 Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fe64d1d65224162b60849eace352cb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fe64d1d65224162b60849eace352cb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fe64d1d65224162b60849eace352cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesSnapshotTestJSON-1137775211 Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Tenant-Id: 4fe64d1d65224162b60849eace352cb4 Apr 14 13:16:44 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1137775211 Apr 14 13:16:44 user devstack@n-api.service[61776]: X-User: tempest-VolumesSnapshotTestJSON-1137775211-project-member Apr 14 13:16:44 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:16:44 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:16:44 user devstack@n-api.service[61776]: X-User-Id: 0f3445d14b0a44fd999bc2fc875c77bb Apr 14 13:16:44 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesSnapshotTestJSON-1137775211-project-member Apr 14 13:16:44 user devstack@n-api.service[61776]: method: > Apr 14 13:16:44 user devstack@n-api.service[61776]: exception: Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 could not be found. Apr 14 13:16:44 user devstack@n-api.service[61776]: action_args: {'id': '387e72a2-6fd9-4cd7-ab72-67535fc67fd5'} Apr 14 13:16:44 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 could not be found. Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 could not be found. Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 could not be found. Apr 14 13:16:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:16:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Returning 404 to user: Instance 387e72a2-6fd9-4cd7-ab72-67535fc67fd5 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e11333bd-5f6e-4bbc-a40f-18e1a3f2f871 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5" status: 404 len: 111 microversion: 2.1 time: 0.035630 Apr 14 13:16:44 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 105/314] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:44 2023] GET /compute/v2.1/servers/387e72a2-6fd9-4cd7-ab72-67535fc67fd5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:16:45 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847e2db8-10a7-416b-ae22-1c75b6d37817", "tag": "af35aee5-c40d-47d2-82ea-3ff57c1d5495"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:45 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] Creating event network-changed:af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance 847e2db8-10a7-416b-ae22-1c75b6d37817 on user Apr 14 13:16:45 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-abcf23d9-3d98-414d-91d3-30fe30773d2d req-86c8433d-9da0-4d76-85b0-3bb55275dd8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040496 Apr 14 13:16:45 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 108/315] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "978f6fc8-1080-4840-ab8a-e025efe4f906", "tag": "4c6952bc-e57c-4679-90f3-e9bd66e864ca"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] Creating event network-changed:4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance 978f6fc8-1080-4840-ab8a-e025efe4f906 on user Apr 14 13:16:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-87a39ff5-f79b-409d-a215-96e5ff1191fa req-81b69784-d80b-478c-8c30-cdd4097c5842 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030518 Apr 14 13:16:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 103/316] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847e2db8-10a7-416b-ae22-1c75b6d37817", "name": "network-vif-plugged", "status": "completed", "tag": "af35aee5-c40d-47d2-82ea-3ff57c1d5495"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] Creating event network-vif-plugged:af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance 847e2db8-10a7-416b-ae22-1c75b6d37817 on user Apr 14 13:16:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-aa805cc1-45b6-4094-a5e2-75ed8cb9bf4f req-9632b3b0-0370-41e1-847c-747e921e316a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075763 Apr 14 13:16:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847e2db8-10a7-416b-ae22-1c75b6d37817", "name": "network-vif-plugged", "status": "completed", "tag": "af35aee5-c40d-47d2-82ea-3ff57c1d5495"}, {"server_uuid": "978f6fc8-1080-4840-ab8a-e025efe4f906", "name": "network-vif-plugged", "status": "completed", "tag": "4c6952bc-e57c-4679-90f3-e9bd66e864ca"}, {"server_uuid": "978f6fc8-1080-4840-ab8a-e025efe4f906", "name": "network-vif-plugged", "status": "completed", "tag": "4c6952bc-e57c-4679-90f3-e9bd66e864ca"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Creating event network-vif-plugged:af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance 847e2db8-10a7-416b-ae22-1c75b6d37817 on user Apr 14 13:16:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Creating event network-vif-plugged:4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance 978f6fc8-1080-4840-ab8a-e025efe4f906 on user Apr 14 13:16:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] Creating event network-vif-plugged:4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance 978f6fc8-1080-4840-ab8a-e025efe4f906 on user Apr 14 13:16:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-01d15613-2d07-4ee9-b9dc-c31f876ac7f8 req-5d520274-8c11-4b50-8271-8a2f4e9cb7a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.067068 Apr 14 13:16:50 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 109/318] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:16:49 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=8 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] HTTP exception thrown: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Request method failure captured: Apr 14 13:16:54 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 HTTP/1.1 Apr 14 13:16:54 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:16:54 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:16:54 user devstack@n-api.service[61775]: Connection: close Apr 14 13:16:54 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:16:54 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:16:54 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:16:54 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:16:54 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE03AgmhXS6ybllUa1k84_h7NILw2L1kHF05VAahUYM1eem6bTUF4T51xDGMJMnhmpIgjoGli3Pz9naGL3bHw-dXzIxpXJ2dGejzaqxSb-svo2Emw7eyjXie8c1g63FE8x5p35Mlh5HnDEQwQTYgtCPHdoGBmB1j1AmLPIlqVIcnU0 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Project-Id: ab3a7e094618456381891d4532bb3cf2 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Project-Name: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Tenant: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Tenant-Id: ab3a7e094618456381891d4532bb3cf2 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-User: tempest-TaggedAttachmentsTest-246329900-project-member Apr 14 13:16:54 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:16:54 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:16:54 user devstack@n-api.service[61775]: X-User-Id: 016ee10024d2449c93d67e0b14f09f95 Apr 14 13:16:54 user devstack@n-api.service[61775]: X-User-Name: tempest-TaggedAttachmentsTest-246329900-project-member Apr 14 13:16:54 user devstack@n-api.service[61775]: method: > Apr 14 13:16:54 user devstack@n-api.service[61775]: exception: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:54 user devstack@n-api.service[61775]: action_args: {'id': '15df44a4-fc31-4dfa-870d-0dd1db47ccd7'} Apr 14 13:16:54 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:54 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:54 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Returning 404 to user: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-6fa8ae28-5585-4ac2-9b74-61598d877193 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7" status: 404 len: 111 microversion: 2.49 time: 0.052936 Apr 14 13:16:54 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 104/319] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:16:54 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:54 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:54 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4cc15b4d-aa46-4b40-adb4-6864181e7b3d tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '.version_select at 0x7fa743b85cf0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4cc15b4d-aa46-4b40-adb4-6864181e7b3d tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468650109" status: 204 len: 0 microversion: 2.49 time: 0.055068 Apr 14 13:16:54 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 107/320] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 13:16:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1468650109 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] HTTP exception thrown: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Request method failure captured: Apr 14 13:16:56 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 HTTP/1.1 Apr 14 13:16:56 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:16:56 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:16:56 user devstack@n-api.service[61774]: Connection: close Apr 14 13:16:56 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:16:56 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:16:56 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:16:56 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:16:56 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE03AgmhXS6ybllUa1k84_h7NILw2L1kHF05VAahUYM1eem6bTUF4T51xDGMJMnhmpIgjoGli3Pz9naGL3bHw-dXzIxpXJ2dGejzaqxSb-svo2Emw7eyjXie8c1g63FE8x5p35Mlh5HnDEQwQTYgtCPHdoGBmB1j1AmLPIlqVIcnU0 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Project-Id: ab3a7e094618456381891d4532bb3cf2 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Project-Name: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Tenant: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Tenant-Id: ab3a7e094618456381891d4532bb3cf2 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-User: tempest-TaggedAttachmentsTest-246329900-project-member Apr 14 13:16:56 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:16:56 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:16:56 user devstack@n-api.service[61774]: X-User-Id: 016ee10024d2449c93d67e0b14f09f95 Apr 14 13:16:56 user devstack@n-api.service[61774]: X-User-Name: tempest-TaggedAttachmentsTest-246329900-project-member Apr 14 13:16:56 user devstack@n-api.service[61774]: method: > Apr 14 13:16:56 user devstack@n-api.service[61774]: exception: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61774]: action_args: {'id': '15df44a4-fc31-4dfa-870d-0dd1db47ccd7'} Apr 14 13:16:56 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Returning 404 to user: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-470c3de1-2002-464f-92c4-02921f00ca23 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7" status: 404 len: 111 microversion: 2.49 time: 0.066912 Apr 14 13:16:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 110/321] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:16:56 2023] DELETE /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] [instance: 15df44a4-fc31-4dfa-870d-0dd1db47ccd7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] HTTP exception thrown: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Request method failure captured: Apr 14 13:16:56 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 HTTP/1.1 Apr 14 13:16:56 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:16:56 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:16:56 user devstack@n-api.service[61775]: Connection: close Apr 14 13:16:56 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:16:56 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:16:56 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:16:56 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:16:56 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE03AgmhXS6ybllUa1k84_h7NILw2L1kHF05VAahUYM1eem6bTUF4T51xDGMJMnhmpIgjoGli3Pz9naGL3bHw-dXzIxpXJ2dGejzaqxSb-svo2Emw7eyjXie8c1g63FE8x5p35Mlh5HnDEQwQTYgtCPHdoGBmB1j1AmLPIlqVIcnU0 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Project-Id: ab3a7e094618456381891d4532bb3cf2 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Project-Name: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ab3a7e094618456381891d4532bb3cf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Tenant: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Tenant-Id: ab3a7e094618456381891d4532bb3cf2 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TaggedAttachmentsTest-246329900 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-User: tempest-TaggedAttachmentsTest-246329900-project-member Apr 14 13:16:56 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:16:56 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:16:56 user devstack@n-api.service[61775]: X-User-Id: 016ee10024d2449c93d67e0b14f09f95 Apr 14 13:16:56 user devstack@n-api.service[61775]: X-User-Name: tempest-TaggedAttachmentsTest-246329900-project-member Apr 14 13:16:56 user devstack@n-api.service[61775]: method: > Apr 14 13:16:56 user devstack@n-api.service[61775]: exception: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61775]: action_args: {'id': '15df44a4-fc31-4dfa-870d-0dd1db47ccd7'} Apr 14 13:16:56 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. Apr 14 13:16:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:16:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] Returning 404 to user: Instance 15df44a4-fc31-4dfa-870d-0dd1db47ccd7 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:16:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-dc2e8a21-bfbc-4a91-a86a-5b37ae227488 tempest-TaggedAttachmentsTest-246329900 tempest-TaggedAttachmentsTest-246329900-project-member] 10.0.0.210 "GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7" status: 404 len: 111 microversion: 2.49 time: 0.037457 Apr 14 13:16:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 105/322] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:16:56 2023] GET /compute/v2.1/servers/15df44a4-fc31-4dfa-870d-0dd1db47ccd7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1047339648", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "548d2c7a-ae94-4d89-8980-cb14f224fca3"}]}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] validate_networks() for [('548d2c7a-ae94-4d89-8980-cb14f224fca3', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting quotas for project 4fe64d1d65224162b60849eace352cb4. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Getting quotas for user 0f3445d14b0a44fd999bc2fc875c77bb and project 4fe64d1d65224162b60849eace352cb4. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:16:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:16:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-26de45d3-a8c2-47b8-8b7b-8d0f89fab17d tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.694140 Apr 14 13:16:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 108/323] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:16:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:16:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-5c112901-2a50-4e39-a219-b333b4b94b00 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:16:58 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-5c112901-2a50-4e39-a219-b333b4b94b00 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:16:58 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-5c112901-2a50-4e39-a219-b333b4b94b00 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3445d14b0a44fd999bc2fc875c77bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe64d1d65224162b60849eace352cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:16:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-5c112901-2a50-4e39-a219-b333b4b94b00 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee" status: 200 len: 1213 microversion: 2.1 time: 0.092672 Apr 14 13:16:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 111/324] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:16:58 2023] GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c051c82-e56a-4a50-a24b-23eb2136f3ee", "tag": "18490e88-a837-4ac8-a475-885551bb6219"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] Creating event network-changed:18490e88-a837-4ac8-a475-885551bb6219 for instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee on user Apr 14 13:17:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-d0c2e43e-ec7f-458f-8e1a-b913129bf4f3 req-253aba32-1c70-424f-b52d-134957d61b7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032869 Apr 14 13:17:03 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 106/325] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:06 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c051c82-e56a-4a50-a24b-23eb2136f3ee", "name": "network-vif-plugged", "status": "completed", "tag": "18490e88-a837-4ac8-a475-885551bb6219"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] Creating event network-vif-plugged:18490e88-a837-4ac8-a475-885551bb6219 for instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee on user Apr 14 13:17:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-ee9d3226-1c89-4fbd-a211-c4dcfd515d98 req-5256f254-1181-4f1a-9df8-ebaad8d18607 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030190 Apr 14 13:17:06 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 109/326] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c051c82-e56a-4a50-a24b-23eb2136f3ee", "name": "network-vif-plugged", "status": "completed", "tag": "18490e88-a837-4ac8-a475-885551bb6219"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=27 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] Creating event network-vif-plugged:18490e88-a837-4ac8-a475-885551bb6219 for instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee on user Apr 14 13:17:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-e500a3c3-bd41-4fe1-9988-48b5e3091700 req-e8c9f072-4235-445b-9bb9-8c80a96d2e12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033111 Apr 14 13:17:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 112/327] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] [instance: 990b083b-744a-42cb-88f3-7ae16a5abed4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] HTTP exception thrown: Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 could not be found. Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Request method failure captured: Apr 14 13:17:09 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4 HTTP/1.1 Apr 14 13:17:09 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:17:09 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:17:09 user devstack@n-api.service[61775]: Connection: close Apr 14 13:17:09 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:17:09 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:17:09 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:17:09 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:17:09 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVEyO5SOt3Xgxt5Enu8IylrWsHl5DM5sZrwu2lvJCyM0072gWswgvJ7NGOBxfur2zif1knf6F_gAeso2D3q3Kjw7OVGwlQVt4m_PWkPS5TLmvMCH_MTmmXqURXSK00qUBCptVG_yp2PwgCV8fgFJ2nk1j84QsrfQ4DYt9-1y2gjTUTI Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Project-Id: 18dfe057a9f742ceb908883f28463a43 Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Project-Name: tempest-TestVolumeSwap-1055532166 Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/18dfe057a9f742ceb908883f28463a43"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/18dfe057a9f742ceb908883f28463a43"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/18dfe057a9f742ceb908883f28463a43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Tenant: tempest-TestVolumeSwap-1055532166 Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Tenant-Id: 18dfe057a9f742ceb908883f28463a43 Apr 14 13:17:09 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TestVolumeSwap-1055532166 Apr 14 13:17:09 user devstack@n-api.service[61775]: X-User: tempest-TestVolumeSwap-1055532166-project-member Apr 14 13:17:09 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:17:09 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:17:09 user devstack@n-api.service[61775]: X-User-Id: 8e33a6a8f8f441978437332de5499609 Apr 14 13:17:09 user devstack@n-api.service[61775]: X-User-Name: tempest-TestVolumeSwap-1055532166-project-member Apr 14 13:17:09 user devstack@n-api.service[61775]: method: > Apr 14 13:17:09 user devstack@n-api.service[61775]: exception: Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 could not be found. Apr 14 13:17:09 user devstack@n-api.service[61775]: action_args: {'id': '990b083b-744a-42cb-88f3-7ae16a5abed4'} Apr 14 13:17:09 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 could not be found. Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 could not be found. Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 could not be found. Apr 14 13:17:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Returning 404 to user: Instance 990b083b-744a-42cb-88f3-7ae16a5abed4 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:17:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0230a9bd-bd08-476e-a8a1-08115ad2b090 tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4" status: 404 len: 111 microversion: 2.1 time: 0.062697 Apr 14 13:17:09 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 107/328] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:09 2023] GET /compute/v2.1/servers/990b083b-744a-42cb-88f3-7ae16a5abed4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:17:09 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:09 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:09 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f955d1e1-f20c-47d9-9f7b-807b629bcd6d tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] Calling method '.version_select at 0x7fa743a00430>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:09 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f955d1e1-f20c-47d9-9f7b-807b629bcd6d tempest-TestVolumeSwap-1055532166 tempest-TestVolumeSwap-1055532166-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-157168234" status: 202 len: 0 microversion: 2.1 time: 0.023327 Apr 14 13:17:09 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 110/329] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:17:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-157168234 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:12 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7b488bb4-e8ca-46a7-9705-517cb10c020c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1701 microversion: 2.1 time: 0.270226 Apr 14 13:17:12 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 113/330] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:11 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1701 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e963bf8e-fe5c-48a6-96e2-508f64b52f51 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'create', calling method: .version_select at 0x7fa743bebbe0>, body: {"keypair": {"name": "tempest-keypair-267883713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEyPs5qjqYjK4BZPPS9SLjSpAhI7846QNlutqqoICpW6lWoMgvCP0xnZC5ubrWJhgSvXiZ0Y+MPi9kDdMYjm/8pQep1+cUnz4veyccXy/8c5ZlOOkJ3vavU/zPtzlj1ow=="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:18 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'flavor' on Instance uuid 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:17:18 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-e963bf8e-fe5c-48a6-96e2-508f64b52f51 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for project 4b197f1df57f4dee9757639cf861eb97. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:17:18 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-e963bf8e-fe5c-48a6-96e2-508f64b52f51 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for user 9169729edbd04fd5a74d2cffd0aa437f and project 4b197f1df57f4dee9757639cf861eb97. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:17:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e963bf8e-fe5c-48a6-96e2-508f64b52f51 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.288664 Apr 14 13:17:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 108/331] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:17:17 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4f22ec27-4ab3-490a-9bfb-f6dc4dc68eda tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/action" status: 200 len: 32 microversion: 2.1 time: 0.155300 Apr 14 13:17:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 111/332] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:17:17 2023] POST /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:18 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-51d250cb-b2e9-427b-8f99-27848a258e52 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 200 len: 1509 microversion: 2.1 time: 0.416860 Apr 14 13:17:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 114/333] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:18 2023] GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:19 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=7 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-unplugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] Creating event network-vif-unplugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:17:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-367a5748-f3e4-4278-b9c8-f5be5e68f1d5 req-4bb1d554-c074-4d60-83da-cad3cd782756 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047356 Apr 14 13:17:19 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 109/334] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1306609806", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0a1c90dc-274e-4aab-a239-6a786eb8d0be"}], "security_groups": [{"name": "tempest-securitygroup--223865367"}], "key_name": "tempest-keypair-267883713", "user_data": "}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] validate_networks() for [('0a1c90dc-274e-4aab-a239-6a786eb8d0be', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for project 4b197f1df57f4dee9757639cf861eb97. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for user 9169729edbd04fd5a74d2cffd0aa437f and project 4b197f1df57f4dee9757639cf861eb97. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:17:20 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:17:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-997d9562-878b-4505-9ee5-68f1d13bb599 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.922482 Apr 14 13:17:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 112/335] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:17:19 2023] POST /compute/v2.1/servers => generated 406 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:17:20 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b1eb4ca5-6886-4ad9-a0f0-72b2b3d19f25 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:20 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-b1eb4ca5-6886-4ad9-a0f0-72b2b3d19f25 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:21 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b1eb4ca5-6886-4ad9-a0f0-72b2b3d19f25 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:21 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b1eb4ca5-6886-4ad9-a0f0-72b2b3d19f25 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1232 microversion: 2.1 time: 0.091875 Apr 14 13:17:21 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 115/336] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:20 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1232 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:22 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:22 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:17:22 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-48a49593-2e97-4e8a-aa49-2c1c674c6e4a req-97e13dc8-89e6-46e9-aece-ad70b9bc4d06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048866 Apr 14 13:17:22 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 110/337] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] Creating event network-changed:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:17:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-8f3609c2-34fa-4bdd-9c7d-73cfe65865b6 req-93b7d9a8-c1ee-4889-92fa-34f2602560f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030549 Apr 14 13:17:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 113/338] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:17:24 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}, {"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:17:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:17:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-50ddbc3c-b0fd-416b-b0fa-e2e1981d1dee req-9a4d58d1-692a-479a-9749-49c75d78fa10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049409 Apr 14 13:17:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 116/339] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:26 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:26 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:17:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-1d76499e-46f2-4aa8-beb4-1dbaa61b3411 req-5f773448-b511-403f-943f-19daf9b3b4a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047351 Apr 14 13:17:26 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 111/340] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:28 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:28 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:17:28 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 HTTP/1.1 Apr 14 13:17:28 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:17:28 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:17:28 user devstack@n-api.service[61776]: Connection: close Apr 14 13:17:28 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:17:28 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:17:28 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:17:28 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:17:28 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:17:28 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:17:28 user devstack@n-api.service[61776]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:17:28 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:17:28 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:17:28 user devstack@n-api.service[61776]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:17:28 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:17:28 user devstack@n-api.service[61776]: method: > Apr 14 13:17:28 user devstack@n-api.service[61776]: exception: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:17:28 user devstack@n-api.service[61776]: action_args: {'id': '24179ea7-82e2-48fd-9aab-2e3bf7edb372'} Apr 14 13:17:28 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:17:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:17:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7b9e6a5d-fd8e-4793-a5fb-3b85d7d36d17 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372" status: 404 len: 111 microversion: 2.1 time: 0.257484 Apr 14 13:17:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 114/341] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:28 2023] GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:17:28 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:28 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-61a3d768-6a6f-4a18-be75-ef011d2afa70 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '.version_select at 0x7fa743beb2e0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:28 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-61a3d768-6a6f-4a18-be75-ef011d2afa70 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-713053172" status: 202 len: 0 microversion: 2.1 time: 0.034154 Apr 14 13:17:28 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 112/342] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:17:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-713053172 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:17:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-802a28c8-820c-4fb7-8ded-fd53fe147006 req-b2b65354-f744-45e5-a62c-fa29fd26f8fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043765 Apr 14 13:17:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 115/343] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e1b93a98-17ac-4385-9a05-367dfdeb4ac5 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.528720 Apr 14 13:17:28 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 117/344] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:17:28 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-interface => generated 283 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] Creating event network-changed:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:17:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-0ef099bb-c3ad-41eb-aa2b-a3f51183d7ea req-caacaf47-b721-4d29-904b-10146f1f2730 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067379 Apr 14 13:17:29 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 118/345] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1445087509"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-5f12dad1-13cf-4725-9572-91760f0be8df tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655" status: 204 len: 0 microversion: 2.1 time: 0.224734 Apr 14 13:17:29 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:17:29 2023] DELETE /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:29 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'services' on Instance uuid c34d24a3-a632-4f05-b6fb-dc3562dc93d6 {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:17:29 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-7653bb66-062e-46b6-bd4d-05f8ee73f87c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-volume_attachments/49056810-6abe-48de-b4bd-71d9f5d45096" status: 202 len: 0 microversion: 2.1 time: 0.804554 Apr 14 13:17:29 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 113/347] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:17:29 2023] DELETE /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-volume_attachments/49056810-6abe-48de-b4bd-71d9f5d45096 => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:17:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:30 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-050d4515-b00e-4ba2-977f-efba73150585 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072865 Apr 14 13:17:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 114/348] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:17:29 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:30 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4166b50a7c49158acc8684eaee6041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1c7d361867b4265bd4e1d13e9e66bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:30 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-8b9fc699-73f6-499f-94bd-d7c81869e7ea tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655" status: 200 len: 1493 microversion: 2.1 time: 0.715390 Apr 14 13:17:30 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:29 2023] GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655 => generated 1493 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:17:31 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:31 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e2f59d07-a718-4e74-a1f0-b6db738a7484 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "POST /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/action" status: 202 len: 0 microversion: 2.1 time: 1.329397 Apr 14 13:17:31 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 119/350] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:17:29 2023] POST /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/action => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 449 bytes (2 switches on core 0) Apr 14 13:17:31 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e52824e1-a9d5-4bfb-b046-9b46e1a72d62 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '.version_select at 0x7fa743beb640>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:31 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e52824e1-a9d5-4bfb-b046-9b46e1a72d62 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/images/2bbf35e4-1378-46df-84f2-f839983f7fd6" status: 200 len: 1609 microversion: 2.1 time: 0.078173 Apr 14 13:17:31 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 115/351] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 13:17:31 2023] GET /compute/v2.1/images/2bbf35e4-1378-46df-84f2-f839983f7fd6 => generated 1609 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:31 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb40ccf2-2c37-46ff-be3d-242dc69d0655", "name": "network-vif-unplugged", "status": "completed", "tag": "8cb2e08e-e795-4c9f-ac2c-e249116ef595"}, {"server_uuid": "bb40ccf2-2c37-46ff-be3d-242dc69d0655", "name": "network-vif-plugged", "status": "completed", "tag": "8cb2e08e-e795-4c9f-ac2c-e249116ef595"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:31 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:31 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:31 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Creating event network-vif-unplugged:8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 on user Apr 14 13:17:31 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] Creating event network-vif-plugged:8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 on user Apr 14 13:17:31 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-b508a152-334c-46c5-a7c6-d22d1930532c req-aec8e00a-7bdf-44eb-9b29-a2434ea9e5d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045575 Apr 14 13:17:31 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 118/352] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:31 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:32 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:32 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a039dec1-8a64-4a67-bde6-83d8ba7b059b tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 200 len: 1494 microversion: 2.1 time: 0.336238 Apr 14 13:17:32 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 120/353] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:32 2023] GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 1494 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:32 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:32 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:33 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:33 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:33 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9fad070f-0232-4516-a7af-d804fdd3a15d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906" status: 200 len: 1690 microversion: 2.87 time: 0.445425 Apr 14 13:17:33 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 116/354] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:17:32 2023] GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906 => generated 1690 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:17:33 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-ac251617-6788-41ac-971a-1c6b9899ae52 req-0aa66beb-e87b-40f7-b25d-72dcaf3c9fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb40ccf2-2c37-46ff-be3d-242dc69d0655", "name": "network-vif-deleted", "tag": "8cb2e08e-e795-4c9f-ac2c-e249116ef595"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ac251617-6788-41ac-971a-1c6b9899ae52 req-0aa66beb-e87b-40f7-b25d-72dcaf3c9fea service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ac251617-6788-41ac-971a-1c6b9899ae52 req-0aa66beb-e87b-40f7-b25d-72dcaf3c9fea service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ac251617-6788-41ac-971a-1c6b9899ae52 req-0aa66beb-e87b-40f7-b25d-72dcaf3c9fea service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-ac251617-6788-41ac-971a-1c6b9899ae52 req-0aa66beb-e87b-40f7-b25d-72dcaf3c9fea service nova] Creating event network-vif-deleted:8cb2e08e-e795-4c9f-ac2c-e249116ef595 for instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 on user Apr 14 13:17:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-ac251617-6788-41ac-971a-1c6b9899ae52 req-0aa66beb-e87b-40f7-b25d-72dcaf3c9fea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037068 Apr 14 13:17:33 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1701137510", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "be533313-1783-4791-b33f-7b13e2201700"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:38 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=20 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] validate_networks() for [('be533313-1783-4791-b33f-7b13e2201700', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Getting quotas for project e50c008548ed42bbaffac5876989b3a0. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Getting quotas for user 2272cf2bf2f148e59dd600921894bb65 and project e50c008548ed42bbaffac5876989b3a0. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:17:39 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:17:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-8711ddce-b1cf-4e36-a414-fe8ee5e6b948 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.826018 Apr 14 13:17:39 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 121/356] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:17:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:17:39 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7f0b81a1-44d5-484a-b33f-7ce21ba7c512 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:39 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-7f0b81a1-44d5-484a-b33f-7ce21ba7c512 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:39 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-7f0b81a1-44d5-484a-b33f-7ce21ba7c512 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2272cf2bf2f148e59dd600921894bb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c008548ed42bbaffac5876989b3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:39 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-7f0b81a1-44d5-484a-b33f-7ce21ba7c512 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754" status: 200 len: 1208 microversion: 2.1 time: 0.068735 Apr 14 13:17:39 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 117/357] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:39 2023] GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754 => generated 1208 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:40 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7daff6d8-a311-4133-b98d-fa6d2eb40ec1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'create', calling method: .version_select at 0x7fa743b856c0>, body: {"keypair": {"name": "tempest-keypair-1859762998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe8+NQxdd30Id654GBmcPwxA0JUpEg+Hy4COx6Fb893eVwtn8PELZv6pRPgbhjQTvkkY11PVtxzwFy1OaWZde1spOAQMgX1ADyyiK3GMyy+wZuqUsAbmtL2UTWG2YF/Rg=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:40 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-7daff6d8-a311-4133-b98d-fa6d2eb40ec1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting quotas for project 8f0fee50983a4e31b1689dc77b1c4db1. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:17:40 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-7daff6d8-a311-4133-b98d-fa6d2eb40ec1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting quotas for user f04370605aec40a0a53a080c1e8bf8a8 and project 8f0fee50983a4e31b1689dc77b1c4db1. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:17:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7daff6d8-a311-4133-b98d-fa6d2eb40ec1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.135274 Apr 14 13:17:40 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 120/358] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 13:17:40 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 13:17:42 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2054124847", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ce72cb91-222b-4491-af4a-bd9a67637d69"}], "security_groups": [{"name": "tempest-securitygroup--1884282072"}], "key_name": "tempest-keypair-1859762998", "user_data": "}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:42 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "6494c06a-6954-4b2c-9bb2-245efd7a33bc"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:42 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] HTTP exception thrown: Volume 1bf6ef00-cbcf-4344-91e1-904f61133779 could not be found. Apr 14 13:17:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Request method failure captured: Apr 14 13:17:43 user devstack@n-api.service[61775]: request: PUT /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302/os-volume_attachments/1bf6ef00-cbcf-4344-91e1-904f61133779 HTTP/1.1 Apr 14 13:17:43 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:17:43 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:17:43 user devstack@n-api.service[61775]: Connection: close Apr 14 13:17:43 user devstack@n-api.service[61775]: Content-Length: 74 Apr 14 13:17:43 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:17:43 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:17:43 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:17:43 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVFJk7QazRdOmTspMFrsZpsCUBDsLxEiFawGPtiRTZ3Kk2xlT0MAx0z6qsQLsjF52s50HfGaiyfLvuTmKpI11wS--5_oH5GZwgCCYLo-ExC1s3jf-EN4tNbRZwpLUB9Sx_JwvutzKy2eOUNpCx17KjvGpgePxESP4l2x6M81ejcs--0 Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Project-Id: 6af20cbafad748da99bae1629d07c124 Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Project-Name: tempest-VolumesAdminNegativeTest-900239531 Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Role: reader,admin,member Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Roles: reader,admin,member Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6af20cbafad748da99bae1629d07c124"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6af20cbafad748da99bae1629d07c124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6af20cbafad748da99bae1629d07c124"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Tenant: tempest-VolumesAdminNegativeTest-900239531 Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Tenant-Id: 6af20cbafad748da99bae1629d07c124 Apr 14 13:17:43 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-900239531 Apr 14 13:17:43 user devstack@n-api.service[61775]: X-User: tempest-VolumesAdminNegativeTest-900239531-project-admin Apr 14 13:17:43 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:17:43 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:17:43 user devstack@n-api.service[61775]: X-User-Id: 51bda014c18844e0a685a23e2ff48354 Apr 14 13:17:43 user devstack@n-api.service[61775]: X-User-Name: tempest-VolumesAdminNegativeTest-900239531-project-admin Apr 14 13:17:43 user devstack@n-api.service[61775]: Apr 14 13:17:43 user devstack@n-api.service[61775]: {"volumeAttachment": {"volumeId": "6494c06a-6954-4b2c-9bb2-245efd7a33bc"}} Apr 14 13:17:43 user devstack@n-api.service[61775]: method: > Apr 14 13:17:43 user devstack@n-api.service[61775]: exception: Volume 1bf6ef00-cbcf-4344-91e1-904f61133779 could not be found. Apr 14 13:17:43 user devstack@n-api.service[61775]: action_args: {'server_id': '8b5d7047-087e-44f4-b977-12c719f5a302', 'id': '1bf6ef00-cbcf-4344-91e1-904f61133779', 'body': {'volumeAttachment': {'volumeId': '6494c06a-6954-4b2c-9bb2-245efd7a33bc'}}} Apr 14 13:17:43 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1bf6ef00-cbcf-4344-91e1-904f61133779 could not be found. (HTTP 404) (Request-ID: req-e93b259d-ba77-4c19-90d9-32fd40a9290f) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1bf6ef00-cbcf-4344-91e1-904f61133779 could not be found. Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1bf6ef00-cbcf-4344-91e1-904f61133779 could not be found. Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1bf6ef00-cbcf-4344-91e1-904f61133779 could not be found. Apr 14 13:17:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:17:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] Returning 404 to user: Volume 1bf6ef00-cbcf-4344-91e1-904f61133779 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:17:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-db8d2b20-8a6a-41f6-88e4-1cca73cf510f tempest-VolumesAdminNegativeTest-900239531 tempest-VolumesAdminNegativeTest-900239531-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302/os-volume_attachments/1bf6ef00-cbcf-4344-91e1-904f61133779" status: 404 len: 109 microversion: 2.1 time: 0.103886 Apr 14 13:17:43 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 118/359] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 13:17:42 2023] PUT /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302/os-volume_attachments/1bf6ef00-cbcf-4344-91e1-904f61133779 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:17:43 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9e5ef7-70a6-449b-bc05-ff1d80465754", "tag": "697153ca-2b37-46af-a0d3-7624fea31022"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:43 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:43 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] validate_networks() for [('ce72cb91-222b-4491-af4a-bd9a67637d69', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:17:43 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:43 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] Creating event network-changed:697153ca-2b37-46af-a0d3-7624fea31022 for instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 on user Apr 14 13:17:43 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-530a7878-2cac-41ae-9144-6396586cfd6d req-9fc7494e-7754-47a9-a05a-e1b0c3d94de4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097245 Apr 14 13:17:43 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 121/360] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting quotas for project 8f0fee50983a4e31b1689dc77b1c4db1. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting quotas for user f04370605aec40a0a53a080c1e8bf8a8 and project 8f0fee50983a4e31b1689dc77b1c4db1. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:17:43 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:17:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-abe2beb4-d5f4-4eb5-adf6-705d4d527875 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.088424 Apr 14 13:17:43 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 122/361] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 13:17:42 2023] POST /compute/v2.1/servers => generated 400 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:17:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-51fa380d-3d86-4856-91d6-78dcdaf60c92 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:44 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-51fa380d-3d86-4856-91d6-78dcdaf60c92 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:44 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-51fa380d-3d86-4856-91d6-78dcdaf60c92 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:44 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-51fa380d-3d86-4856-91d6-78dcdaf60c92 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:44 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-51fa380d-3d86-4856-91d6-78dcdaf60c92 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-51fa380d-3d86-4856-91d6-78dcdaf60c92 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 200 len: 1276 microversion: 2.20 time: 0.065905 Apr 14 13:17:44 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 119/362] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:17:43 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 1276 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:17:45 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e5ef7-70a6-449b-bc05-ff1d80465754", "name": "network-vif-plugged", "status": "completed", "tag": "697153ca-2b37-46af-a0d3-7624fea31022"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] Creating event network-vif-plugged:697153ca-2b37-46af-a0d3-7624fea31022 for instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 on user Apr 14 13:17:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-525c8318-4b64-41b0-93d9-a0489d99de9d req-6e692cfc-49cf-4235-8e49-3645a252ebc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139906 Apr 14 13:17:45 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 122/363] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:17:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-303d9314-0bd2-4721-99cc-6b82b7704ca7 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302" status: 204 len: 0 microversion: 2.1 time: 0.120653 Apr 14 13:17:46 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 123/364] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:17:46 2023] DELETE /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:46 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1387c0adbe74072b52886ddc2af4182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9094bc9720194f02abdc6d0b081c7e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b41784af-912c-4d85-983d-ad56f746c943 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302" status: 200 len: 1501 microversion: 2.1 time: 0.282052 Apr 14 13:17:46 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 120/365] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:46 2023] GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302 => generated 1501 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] Creating event network-changed:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:17:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-4e0eaf64-37d8-4d16-a45e-7635a395370f req-034baded-2c77-4a18-8e35-873c0988eff3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038460 Apr 14 13:17:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 123/366] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e5ef7-70a6-449b-bc05-ff1d80465754", "name": "network-vif-plugged", "status": "completed", "tag": "697153ca-2b37-46af-a0d3-7624fea31022"}, {"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-unplugged", "status": "completed", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}, {"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-plugged", "status": "completed", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}, {"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-plugged", "status": "completed", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Creating event network-vif-plugged:697153ca-2b37-46af-a0d3-7624fea31022 for instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 on user Apr 14 13:17:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Creating event network-vif-unplugged:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:17:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Creating event network-vif-plugged:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:17:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] Creating event network-vif-plugged:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:17:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-2d102acb-eade-4fee-acf9-fb023b4282bd req-c7a94fe2-d5e2-41bc-bd06-e13b1e22a896 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.064583 Apr 14 13:17:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:47 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:48 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:17:48 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:17:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-36ac1acb-4631-4a2a-8d08-949b0bcfaf7a req-a3d83371-94d4-4877-baba-d7fab61f7d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-deleted", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-36ac1acb-4631-4a2a-8d08-949b0bcfaf7a req-a3d83371-94d4-4877-baba-d7fab61f7d1e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-36ac1acb-4631-4a2a-8d08-949b0bcfaf7a req-a3d83371-94d4-4877-baba-d7fab61f7d1e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-36ac1acb-4631-4a2a-8d08-949b0bcfaf7a req-a3d83371-94d4-4877-baba-d7fab61f7d1e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-36ac1acb-4631-4a2a-8d08-949b0bcfaf7a req-a3d83371-94d4-4877-baba-d7fab61f7d1e service nova] Creating event network-vif-deleted:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:17:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-36ac1acb-4631-4a2a-8d08-949b0bcfaf7a req-a3d83371-94d4-4877-baba-d7fab61f7d1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044053 Apr 14 13:17:49 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 124/368] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:49 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3445d14b0a44fd999bc2fc875c77bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe64d1d65224162b60849eace352cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:17:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-98337588-b2ba-46db-86bb-c738f087b2a4 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee" status: 200 len: 1497 microversion: 2.1 time: 0.231668 Apr 14 13:17:49 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 121/369] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:17:48 2023] GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee => generated 1497 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:17:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:17:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-576b2ad2-edd6-4beb-a6e6-0ddd7672e2c4 req-7aeb2ce2-5283-455f-9fe6-4dd3ee9421b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144467 Apr 14 13:17:49 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 125/370] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-plugged", "status": "completed", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}, {"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-unplugged", "status": "completed", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}, {"server_uuid": "8b5d7047-087e-44f4-b977-12c719f5a302", "name": "network-vif-plugged", "status": "completed", "tag": "bc9a4ea0-414f-43d8-995a-edb489f1b810"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Creating event network-vif-plugged:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:17:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Creating event network-vif-unplugged:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:17:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] Creating event network-vif-plugged:bc9a4ea0-414f-43d8-995a-edb489f1b810 for instance 8b5d7047-087e-44f4-b977-12c719f5a302 on user Apr 14 13:17:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-48786f03-35ac-4f4b-8390-478ef689b582 req-f6f273bf-9c10-4a1f-996d-a35acda8c128 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.031144 Apr 14 13:17:49 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:17:51 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:17:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:17:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:17:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:17:51 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:17:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:17:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-47cb07e9-6da7-4ac2-b14f-ad715e0faa0d req-8ad13751-e2a2-4d98-974e-88860cb92664 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 Apr 14 13:17:51 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 122/372] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=12 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:09 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:09 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c388e43a-b7b1-415e-bd36-75d762fa59a5 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 200 len: 1489 microversion: 2.1 time: 0.362942 Apr 14 13:18:09 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 126/373] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:08 2023] GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 1489 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=3 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:11 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:11 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-384cd57c-eae0-46b3-b8bb-882ea7eb2451 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1538 microversion: 2.1 time: 0.258842 Apr 14 13:18:11 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 126/374] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:11 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1538 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:12 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'services' on Instance uuid 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:18:12 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-bb841982-f283-42f4-8a5b-c459ef91c6fd tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/os-volume_attachments/7f6a3c6d-43d9-4137-b0e1-699b36e9b999" status: 202 len: 0 microversion: 2.1 time: 0.274862 Apr 14 13:18:12 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 123/375] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:18:12 2023] DELETE /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/os-volume_attachments/7f6a3c6d-43d9-4137-b0e1-699b36e9b999 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:18:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Going to try to stop instance {{(pid=61774) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 13:18:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1bb8a927-c25f-4657-be5e-95c486d914a8 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.066754 Apr 14 13:18:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 127/376] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:18:14 2023] POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/action => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 13:18:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:14 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:15 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:15 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9c570bbb-c406-4ff5-bec5-513a48879c70 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1665 microversion: 2.1 time: 0.316459 Apr 14 13:18:15 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 127/377] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:14 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1665 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:15 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] Creating event network-vif-unplugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:18:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-026ce24c-d8e4-4454-8f40-717b5fa2c379 req-bbccb5b1-b4e6-4e4a-ad29-5d27b2846b26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037195 Apr 14 13:18:15 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 124/378] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:18:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:18:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:18:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-f0b2d149-83a3-400e-a91d-8b2deed9b42b req-ba88b321-19bd-4afe-b6c1-65ac549615d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045344 Apr 14 13:18:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 128/379] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:18:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9ce9f74a-8efc-4cd9-bc90-7afa9426f9c7 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041695 Apr 14 13:18:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 128/380] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:18:20 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:18:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e0eec561-b7b6-4403-9c4f-cf8bd426dda0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6" status: 204 len: 0 microversion: 2.1 time: 0.144086 Apr 14 13:18:20 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 125/381] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:18:20 2023] DELETE /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] [instance: bb40ccf2-2c37-46ff-be3d-242dc69d0655] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] HTTP exception thrown: Instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 could not be found. Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Request method failure captured: Apr 14 13:18:20 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655 HTTP/1.1 Apr 14 13:18:20 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:18:20 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:18:20 user devstack@n-api.service[61776]: Connection: close Apr 14 13:18:20 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:18:20 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:18:20 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:18:20 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:18:20 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVFR7VGYIQ3yiZFvrtFnkVIi3EyGSpyRZkN5YVWMGRjqbtHwBDNp6lC0xEqDYVqJ60JU3GwVqmn_wFYGKg579XcoU0lKfm0j6bjvFT-nVTQCXYHbJDawa8R3gBA4nrm8SkRobOKWsdFrz7bXIG3dj61jqX0AMFk1hxBfggCGueLN9hI Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Project-Id: e1c7d361867b4265bd4e1d13e9e66bc4 Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesActionsTest-2125520108 Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e1c7d361867b4265bd4e1d13e9e66bc4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1c7d361867b4265bd4e1d13e9e66bc4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1c7d361867b4265bd4e1d13e9e66bc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesActionsTest-2125520108 Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Tenant-Id: e1c7d361867b4265bd4e1d13e9e66bc4 Apr 14 13:18:20 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesActionsTest-2125520108 Apr 14 13:18:20 user devstack@n-api.service[61776]: X-User: tempest-VolumesActionsTest-2125520108-project-member Apr 14 13:18:20 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:18:20 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:18:20 user devstack@n-api.service[61776]: X-User-Id: 1c4166b50a7c49158acc8684eaee6041 Apr 14 13:18:20 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesActionsTest-2125520108-project-member Apr 14 13:18:20 user devstack@n-api.service[61776]: method: > Apr 14 13:18:20 user devstack@n-api.service[61776]: exception: Instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 could not be found. Apr 14 13:18:20 user devstack@n-api.service[61776]: action_args: {'id': 'bb40ccf2-2c37-46ff-be3d-242dc69d0655'} Apr 14 13:18:20 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 could not be found. Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 could not be found. Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 could not be found. Apr 14 13:18:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] Returning 404 to user: Instance bb40ccf2-2c37-46ff-be3d-242dc69d0655 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:18:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-dc2f9ce0-cbc1-4628-90f6-e4e2af4809a7 tempest-VolumesActionsTest-2125520108 tempest-VolumesActionsTest-2125520108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655" status: 404 len: 111 microversion: 2.1 time: 0.161022 Apr 14 13:18:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 129/382] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:20 2023] GET /compute/v2.1/servers/bb40ccf2-2c37-46ff-be3d-242dc69d0655 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:18:20 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34d24a3-a632-4f05-b6fb-dc3562dc93d6", "name": "network-vif-unplugged", "status": "completed", "tag": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a3d9809f-5921-4496-a1f5-ef639510264f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6" status: 200 len: 1668 microversion: 2.1 time: 0.437892 Apr 14 13:18:20 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 129/383] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:20 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => generated 1668 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] Creating event network-vif-unplugged:5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 on user Apr 14 13:18:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-f95da0c9-a36b-4c91-97d6-92d159a38e7e req-1a4c7652-741d-4831-94e6-e7de47fcf53b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035810 Apr 14 13:18:20 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 126/384] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:18:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:18:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-369466b6-27dc-4e4a-ac62-501eb64f4f3c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '.version_select at 0x7fa743c22ef0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-369466b6-27dc-4e4a-ac62-501eb64f4f3c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/images/2bbf35e4-1378-46df-84f2-f839983f7fd6" status: 200 len: 1723 microversion: 2.1 time: 0.053497 Apr 14 13:18:21 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 130/385] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 13:18:21 2023] GET /compute/v2.1/images/2bbf35e4-1378-46df-84f2-f839983f7fd6 => generated 1723 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:21 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-64154749-8b10-44bb-81fe-d85754d31324 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '.version_select at 0x7fa743adfb50>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:21 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-64154749-8b10-44bb-81fe-d85754d31324 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/images/2bbf35e4-1378-46df-84f2-f839983f7fd6" status: 200 len: 1723 microversion: 2.1 time: 0.049839 Apr 14 13:18:21 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 130/386] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 13:18:21 2023] GET /compute/v2.1/images/2bbf35e4-1378-46df-84f2-f839983f7fd6 => generated 1723 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:21 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065f23d461f44751a6911adcd3124fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b733f664b340e289c562e19ebd28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-48c1285b-fefd-479c-a6ae-69311f7bba3f tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 200 len: 1672 microversion: 2.1 time: 0.221553 Apr 14 13:18:21 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 127/387] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:21 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:22 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34d24a3-a632-4f05-b6fb-dc3562dc93d6", "name": "network-vif-plugged", "status": "completed", "tag": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4"}, {"server_uuid": "c34d24a3-a632-4f05-b6fb-dc3562dc93d6", "name": "network-vif-deleted", "tag": "5fab05b1-9e56-4f0d-84e0-22573efdb2c4"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:22 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Creating event network-vif-plugged:5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 on user Apr 14 13:18:22 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] Creating event network-vif-deleted:5fab05b1-9e56-4f0d-84e0-22573efdb2c4 for instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 on user Apr 14 13:18:22 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0b4acd9e-01a1-4830-8559-f8940d1b63d6 req-88e83c99-3c84-4715-8933-77c099c25835 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049216 Apr 14 13:18:22 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 131/388] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:18:22 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:18:29 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:29 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:30 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2272cf2bf2f148e59dd600921894bb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c008548ed42bbaffac5876989b3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:30 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-2fc6e3d1-8252-4675-91a1-fd092f098fb7 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754" status: 200 len: 1486 microversion: 2.1 time: 0.288597 Apr 14 13:18:30 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 131/389] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:29 2023] GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754 => generated 1486 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:32 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1833341696", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "73061151-2d01-43ae-9ac6-841d71c038ba"}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:32 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:32 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:32 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] validate_networks() for [('73061151-2d01-43ae-9ac6-841d71c038ba', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Getting quotas for project d4b4e44c0b8945079de567503aab3a12. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Getting quotas for user 3f713f95191542f6a23ee25669061b27 and project d4b4e44c0b8945079de567503aab3a12. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:18:33 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:18:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-93d8f859-e92a-4510-a7ea-4867881997a3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.695174 Apr 14 13:18:33 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 128/390] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:18:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:18:33 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=10 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:33 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=22 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:33 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d756a43d-c104-4e9f-bab6-0c7dda5f82bf tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:33 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d756a43d-c104-4e9f-bab6-0c7dda5f82bf tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:33 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-d756a43d-c104-4e9f-bab6-0c7dda5f82bf tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d756a43d-c104-4e9f-bab6-0c7dda5f82bf tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f" status: 200 len: 1211 microversion: 2.1 time: 0.131624 Apr 14 13:18:33 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 132/391] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:33 2023] GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:18:33 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-9185669"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:33 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:34 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:34 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:35 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:35 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:35 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:35 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-19d840e4-bf8b-4ded-a809-565babf76403 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 200 len: 1587 microversion: 2.20 time: 0.934892 Apr 14 13:18:35 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 129/392] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:18:34 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 1587 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:18:35 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-78aeabc1-c3c7-4dc9-8c3f-a9657aa22b02 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906/action" status: 202 len: 52 microversion: 2.87 time: 1.760345 Apr 14 13:18:35 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 132/393] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:18:33 2023] POST /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906/action => generated 52 bytes in 1762 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: 8b5d7047-087e-44f4-b977-12c719f5a302] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:36 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] HTTP exception thrown: Instance 8b5d7047-087e-44f4-b977-12c719f5a302 could not be found. Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Request method failure captured: Apr 14 13:18:36 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302 HTTP/1.1 Apr 14 13:18:36 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:18:36 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:18:36 user devstack@n-api.service[61776]: Connection: close Apr 14 13:18:36 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:18:36 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:18:36 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:18:36 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:18:36 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVEyzZ3V79Pxe2dv4GDgoNjEX-apnTirRRCxEpfYsn6-W01U9z9l-wCxcQkvKRVlGutB0KtnzNDXiBQ84YIOlq8uENHkfXCNv371UvaotOeq7P53URwGpaB8XiKZyRlr5qYs_pPnvQYUo3uDN4iyM9e4TSM5Uyrmm8Dp9_D4c3eHazA Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Project-Id: 9094bc9720194f02abdc6d0b081c7e32 Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesAdminNegativeTest-1303459042 Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9094bc9720194f02abdc6d0b081c7e32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9094bc9720194f02abdc6d0b081c7e32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9094bc9720194f02abdc6d0b081c7e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesAdminNegativeTest-1303459042 Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Tenant-Id: 9094bc9720194f02abdc6d0b081c7e32 Apr 14 13:18:36 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1303459042 Apr 14 13:18:36 user devstack@n-api.service[61776]: X-User: tempest-VolumesAdminNegativeTest-1303459042-project-member Apr 14 13:18:36 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:18:36 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:18:36 user devstack@n-api.service[61776]: X-User-Id: f1387c0adbe74072b52886ddc2af4182 Apr 14 13:18:36 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesAdminNegativeTest-1303459042-project-member Apr 14 13:18:36 user devstack@n-api.service[61776]: method: > Apr 14 13:18:36 user devstack@n-api.service[61776]: exception: Instance 8b5d7047-087e-44f4-b977-12c719f5a302 could not be found. Apr 14 13:18:36 user devstack@n-api.service[61776]: action_args: {'id': '8b5d7047-087e-44f4-b977-12c719f5a302'} Apr 14 13:18:36 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5d7047-087e-44f4-b977-12c719f5a302 could not be found. Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5d7047-087e-44f4-b977-12c719f5a302 could not be found. Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5d7047-087e-44f4-b977-12c719f5a302 could not be found. Apr 14 13:18:36 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:18:36 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Returning 404 to user: Instance 8b5d7047-087e-44f4-b977-12c719f5a302 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:18:36 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-cead963c-efe9-4029-8c65-1624e6011837 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302" status: 404 len: 111 microversion: 2.1 time: 0.040994 Apr 14 13:18:36 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 133/394] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:36 2023] GET /compute/v2.1/servers/8b5d7047-087e-44f4-b977-12c719f5a302 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:18:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e06aa11-247c-48ff-adc2-f321e6c72f1f", "tag": "5a229da1-537f-4dce-b171-39cf5b5cd438"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] Creating event network-changed:5a229da1-537f-4dce-b171-39cf5b5cd438 for instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f on user Apr 14 13:18:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-8f7c4914-66d9-458a-aed0-287c6fb54422 req-02aa269a-d844-49ba-990d-5632286552b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098092 Apr 14 13:18:38 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 130/395] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:18:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=13 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:40 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:18:40 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b30adb83-29aa-411d-b3ad-1a7bee6a9212 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a" status: 204 len: 0 microversion: 2.1 time: 0.278709 Apr 14 13:18:40 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 133/396] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:18:40 2023] DELETE /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:40 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1387c0adbe74072b52886ddc2af4182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9094bc9720194f02abdc6d0b081c7e32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-42f9c67c-307c-427c-b117-48060c943b99 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a" status: 200 len: 1669 microversion: 2.1 time: 0.406847 Apr 14 13:18:41 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 134/397] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:18:40 2023] GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a => generated 1669 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:18:41 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74c3463-6701-4150-9096-1775785e8e2a", "name": "network-vif-unplugged", "status": "completed", "tag": "81acf974-1e47-44a8-822c-3d47187e3ae5"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] Creating event network-vif-unplugged:81acf974-1e47-44a8-822c-3d47187e3ae5 for instance c74c3463-6701-4150-9096-1775785e8e2a on user Apr 14 13:18:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-fb085b6c-655b-479e-b424-3694ce83f551 req-cbf77c39-3ec2-4ff3-b363-57b9453b8cc9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049511 Apr 14 13:18:41 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 131/398] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:18:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:18:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74c3463-6701-4150-9096-1775785e8e2a", "name": "network-vif-plugged", "status": "completed", "tag": "81acf974-1e47-44a8-822c-3d47187e3ae5"}, {"server_uuid": "1e06aa11-247c-48ff-adc2-f321e6c72f1f", "name": "network-vif-plugged", "status": "completed", "tag": "5a229da1-537f-4dce-b171-39cf5b5cd438"}, {"server_uuid": "1e06aa11-247c-48ff-adc2-f321e6c72f1f", "name": "network-vif-plugged", "status": "completed", "tag": "5a229da1-537f-4dce-b171-39cf5b5cd438"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Creating event network-vif-plugged:81acf974-1e47-44a8-822c-3d47187e3ae5 for instance c74c3463-6701-4150-9096-1775785e8e2a on user Apr 14 13:18:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Creating event network-vif-plugged:5a229da1-537f-4dce-b171-39cf5b5cd438 for instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f on user Apr 14 13:18:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] Creating event network-vif-plugged:5a229da1-537f-4dce-b171-39cf5b5cd438 for instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f on user Apr 14 13:18:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-be375c85-3db3-49e9-a267-3a158ab96e49 req-c14ec19a-6522-4c93-bcd9-64f6ac64f389 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042659 Apr 14 13:18:43 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 134/399] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:18:43 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:45 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:45 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:45 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:18:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9b7c8bfc-a80f-4866-8a50-7fa6b5ce5ec6 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906" status: 200 len: 1690 microversion: 2.87 time: 0.382009 Apr 14 13:18:45 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 135/400] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:18:44 2023] GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906 => generated 1690 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:18:45 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-dc1141b6-5a5c-408d-9838-96a0766594af req-b1eec805-ea58-4142-aa3c-b66abedf6367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74c3463-6701-4150-9096-1775785e8e2a", "name": "network-vif-deleted", "tag": "81acf974-1e47-44a8-822c-3d47187e3ae5"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:45 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:45 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:18:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dc1141b6-5a5c-408d-9838-96a0766594af req-b1eec805-ea58-4142-aa3c-b66abedf6367 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dc1141b6-5a5c-408d-9838-96a0766594af req-b1eec805-ea58-4142-aa3c-b66abedf6367 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:45 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dc1141b6-5a5c-408d-9838-96a0766594af req-b1eec805-ea58-4142-aa3c-b66abedf6367 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:45 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-dc1141b6-5a5c-408d-9838-96a0766594af req-b1eec805-ea58-4142-aa3c-b66abedf6367 service nova] Creating event network-vif-deleted:81acf974-1e47-44a8-822c-3d47187e3ae5 for instance c74c3463-6701-4150-9096-1775785e8e2a on user Apr 14 13:18:45 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-dc1141b6-5a5c-408d-9838-96a0766594af req-b1eec805-ea58-4142-aa3c-b66abedf6367 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050580 Apr 14 13:18:45 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 132/401] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:18:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:18:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca4b4bd0-29f5-493d-aec2-cf7c01445f27", "device": "/dev/vdb"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:18:49 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:18:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:18:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:18:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:18:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-55ca6a9d-0771-4a88-abfa-6213d42ca7bb tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378727 Apr 14 13:18:49 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 135/402] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:18:49 2023] POST /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1043455417", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=14 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=12 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] validate_networks() for None {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Getting quotas for project fcea4bc3b35746889e1f72cd621d501b. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Getting quotas for user f0868a82043f44a7bc91fc8c6785dc1e and project fcea4bc3b35746889e1f72cd621d501b. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:19:04 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:19:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-0f933c82-b502-486b-949c-c5a6a594c675 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.800697 Apr 14 13:19:04 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 136/403] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:19:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:19:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9669fe69-6d40-4931-b506-01b0c97c3f1e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:04 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9669fe69-6d40-4931-b506-01b0c97c3f1e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:04 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:04 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=14 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:04 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-9669fe69-6d40-4931-b506-01b0c97c3f1e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0868a82043f44a7bc91fc8c6785dc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea4bc3b35746889e1f72cd621d501b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9669fe69-6d40-4931-b506-01b0c97c3f1e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec" status: 200 len: 1209 microversion: 2.1 time: 0.075311 Apr 14 13:19:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 133/404] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:04 2023] GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec => generated 1209 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:05 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-f444fe30-5322-44cb-a69a-2bd3059031c1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1642 microversion: 2.1 time: 0.242244 Apr 14 13:19:05 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 136/405] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:05 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1642 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:07 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e675870-c86b-4ac2-a581-dbad2bdb71ec", "tag": "55e6da39-5c8f-43dc-a24b-cd2e266b4752"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:07 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] Creating event network-changed:55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec on user Apr 14 13:19:07 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-bae0c4ff-3aa8-45b4-9abb-461184ec398b req-ce604178-bf63-4b99-baa0-5ea466de9043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028664 Apr 14 13:19:07 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 137/406] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49e7dfbb-5a74-4879-877f-4d6544ad3abd"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 while it is in vm_state rescued Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Request method failure captured: Apr 14 13:19:09 user devstack@n-api.service[61775]: request: POST /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/os-volume_attachments HTTP/1.1 Apr 14 13:19:09 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:19:09 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:19:09 user devstack@n-api.service[61775]: Connection: close Apr 14 13:19:09 user devstack@n-api.service[61775]: Content-Length: 74 Apr 14 13:19:09 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:19:09 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:19:09 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:19:09 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE7CGJtJfygjQPSdMR9HSJ45TI47-gc7b_dYSZu4c6o-461OeFnWunYQdMelQeuQMoyYrT4x_8u-ku0jtC8aSfJi9VllPjdCnuGgerzPdVXG2IqpenQO2JJJpbhVia5ePLnIh7jnyHBoauudGF2BYrj_V1DNjXJ6YywwM3H7Bd_qAA Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Project-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Tenant-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:19:09 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:19:09 user devstack@n-api.service[61775]: X-User: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:19:09 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:19:09 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:19:09 user devstack@n-api.service[61775]: X-User-Id: 3948b7c643374bcdbeb34f0f2f790c3c Apr 14 13:19:09 user devstack@n-api.service[61775]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:19:09 user devstack@n-api.service[61775]: Apr 14 13:19:09 user devstack@n-api.service[61775]: {"volumeAttachment": {"volumeId": "49e7dfbb-5a74-4879-877f-4d6544ad3abd"}} Apr 14 13:19:09 user devstack@n-api.service[61775]: method: > Apr 14 13:19:09 user devstack@n-api.service[61775]: exception: Cannot 'attach_volume' instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 while it is in vm_state rescued Apr 14 13:19:09 user devstack@n-api.service[61775]: action_args: {'server_id': '29dc5faa-e15a-425c-80f8-ddb4f34f43d4', 'body': {'volumeAttachment': {'volumeId': '49e7dfbb-5a74-4879-877f-4d6544ad3abd'}}} Apr 14 13:19:09 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 while it is in vm_state rescued Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 while it is in vm_state rescued Apr 14 13:19:09 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Returning 409 to user: Cannot 'attach_volume' instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 while it is in vm_state rescued {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:19:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-19d3f621-4c25-4a70-8d80-cf0d6c72947f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055163 Apr 14 13:19:09 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 134/407] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:19:09 2023] POST /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 14 13:19:09 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:09 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:09 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c8f7fbe8-6362-4e6e-98b1-281097bcb014 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/action" status: 202 len: 0 microversion: 2.1 time: 0.079223 Apr 14 13:19:09 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 137/408] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:19:09 2023] POST /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:09 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:09 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d75cd02b-5602-427b-8d6d-9029a8e80383 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 200 len: 1497 microversion: 2.1 time: 0.256899 Apr 14 13:19:09 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 138/409] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:09 2023] GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 1497 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-unplugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] Creating event network-vif-unplugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:19:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-5c5baf6a-9bfd-43c8-bfc0-434e7262075e req-e6cd47db-0f24-4399-9aec-4f9afe465496 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036239 Apr 14 13:19:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 135/410] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:19:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e675870-c86b-4ac2-a581-dbad2bdb71ec", "name": "network-vif-plugged", "status": "completed", "tag": "55e6da39-5c8f-43dc-a24b-cd2e266b4752"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] Creating event network-vif-plugged:55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec on user Apr 14 13:19:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-4d2e40af-df9c-455b-ba4e-bccaf1b51b16 req-e6b47812-6e20-4658-b73d-6759a573b9ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029739 Apr 14 13:19:10 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 138/411] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:19:10 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 HTTP/1.1 Apr 14 13:19:10 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:19:10 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:19:10 user devstack@n-api.service[61776]: Connection: close Apr 14 13:19:10 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:19:10 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:19:10 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:19:10 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:19:10 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:19:10 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:19:10 user devstack@n-api.service[61776]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:19:10 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:19:10 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:19:10 user devstack@n-api.service[61776]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:19:10 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:19:10 user devstack@n-api.service[61776]: method: > Apr 14 13:19:10 user devstack@n-api.service[61776]: exception: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:19:10 user devstack@n-api.service[61776]: action_args: {'id': 'c34d24a3-a632-4f05-b6fb-dc3562dc93d6'} Apr 14 13:19:10 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:19:10 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:19:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4f198d3e-ad1d-4a5b-83fe-0e057fcee70c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6" status: 404 len: 111 microversion: 2.1 time: 0.027900 Apr 14 13:19:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 139/412] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:10 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:19:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-aeee3e42-947d-4c43-9e23-a0aaa8ff40d6 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '.version_select at 0x7fa743ba3490>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-aeee3e42-947d-4c43-9e23-a0aaa8ff40d6 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-359510273" status: 202 len: 0 microversion: 2.1 time: 0.030282 Apr 14 13:19:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 136/413] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:19:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-359510273 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:19:11 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:11 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-2f044d23-c7be-4533-af30-a3a4c6d43d83 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.171615 Apr 14 13:19:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 139/414] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:19:11 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-interface => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:11 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e91177b5-83b5-4645-a250-aaeb2b9fbe07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: .version_select at 0x7fa743c23a30>, body: {"keypair": {"name": "tempest-keypair-858857094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH4IGWPc2G0woSBSu59i2dIWuZuV2nLiEWGcOxBrVeMBfugBK5jZvg3HQO8pKqc4IgnzE7IGw/8/i8zne6vY1fFpHLFViOafQnKXwfPPryecMrr8w+IVET1IuOjpJRNTA=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:11 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-e91177b5-83b5-4645-a250-aaeb2b9fbe07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:19:11 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-e91177b5-83b5-4645-a250-aaeb2b9fbe07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for user 65812c6559684eddbdde33cd64ca1fba and project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:19:11 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e91177b5-83b5-4645-a250-aaeb2b9fbe07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.041567 Apr 14 13:19:11 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 140/415] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:19:11 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:12 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:19:12 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-83b9edc0-fed5-4dd6-b12c-2544fad342b4 req-ee58784c-0b40-4feb-b957-b31965002483 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031305 Apr 14 13:19:12 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 137/416] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:12 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e675870-c86b-4ac2-a581-dbad2bdb71ec", "name": "network-vif-plugged", "status": "completed", "tag": "55e6da39-5c8f-43dc-a24b-cd2e266b4752"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] Creating event network-vif-plugged:55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec on user Apr 14 13:19:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-38fd1038-893c-4c42-8782-ab58ca3b116c req-836ffbf7-a31a-4f01-96f9-6d8f88bf9bb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040979 Apr 14 13:19:12 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 140/417] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:12 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c85c1d7a-79f1-441f-9dff-8948fd9c1a61 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1538 microversion: 2.1 time: 0.245079 Apr 14 13:19:12 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 141/418] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:12 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1538 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:13 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3aa6ba7b-625f-4798-a304-2f7cf61f4939 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1538 microversion: 2.1 time: 0.289774 Apr 14 13:19:13 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 138/419] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:12 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1538 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1960301141", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd"}], "security_groups": [{"name": "tempest-securitygroup--1429565967"}], "key_name": "tempest-keypair-858857094", "user_data": "}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:13 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] validate_networks() for [('2e129bf7-45b2-41b1-ba6f-5f7359c721bd', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for user 65812c6559684eddbdde33cd64ca1fba and project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}, {"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:19:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:19:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-71c3aa57-b3dd-462c-820b-f65babe750ee req-fae6ca4d-d910-4302-b095-11954f4b72e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037167 Apr 14 13:19:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 142/420] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-aa60e921-6bff-434c-bfbf-4d7aac28d491 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.708552 Apr 14 13:19:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 141/421] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:19:13 2023] POST /compute/v2.1/servers => generated 400 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-222bd9e2-8296-4661-845c-6567b34a7ad1 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-222bd9e2-8296-4661-845c-6567b34a7ad1 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-222bd9e2-8296-4661-845c-6567b34a7ad1 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-222bd9e2-8296-4661-845c-6567b34a7ad1 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4" status: 200 len: 1235 microversion: 2.1 time: 0.076648 Apr 14 13:19:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 139/422] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:14 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 => generated 1235 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] Creating event network-changed:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:19:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-859a856e-f84d-4b2c-9b21-654b7cdf671e req-2adabdf8-42ef-46b7-8b08-2701a20a3695 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033698 Apr 14 13:19:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 143/423] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lazy-loading 'services' on Instance uuid 2c051c82-e56a-4a50-a24b-23eb2136f3ee {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:19:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-49c72e97-44a7-4c01-a90b-0f35920b813a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee/os-volume_attachments/ca4b4bd0-29f5-493d-aec2-cf7c01445f27" status: 202 len: 0 microversion: 2.1 time: 0.227995 Apr 14 13:19:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:19:14 2023] DELETE /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee/os-volume_attachments/ca4b4bd0-29f5-493d-aec2-cf7c01445f27 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:19:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-82e0d8a7-452e-4576-bc85-094f8288c5f0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee" status: 204 len: 0 microversion: 2.1 time: 0.120920 Apr 14 13:19:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 140/425] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:19:14 2023] DELETE /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:15 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f3445d14b0a44fd999bc2fc875c77bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe64d1d65224162b60849eace352cb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:15 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-564ba99d-fce0-4dd0-b3ba-a770270d207a tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee" status: 200 len: 1549 microversion: 2.1 time: 0.273828 Apr 14 13:19:15 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 144/426] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:14 2023] GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee => generated 1549 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c051c82-e56a-4a50-a24b-23eb2136f3ee", "name": "network-vif-unplugged", "status": "completed", "tag": "18490e88-a837-4ac8-a475-885551bb6219"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] Creating event network-vif-unplugged:18490e88-a837-4ac8-a475-885551bb6219 for instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee on user Apr 14 13:19:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-a4ba22fa-0c4e-43c8-a964-b0725583240b req-201fd205-ba4f-47eb-aa6d-0e9feb8b1739 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048196 Apr 14 13:19:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 143/427] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca3424c-cbca-4520-a495-8867c2a9c0c4", "tag": "e4d4e52c-5363-4345-9db1-022e8287c65a"}, {"server_uuid": "2c051c82-e56a-4a50-a24b-23eb2136f3ee", "name": "network-vif-plugged", "status": "completed", "tag": "18490e88-a837-4ac8-a475-885551bb6219"}, {"server_uuid": "2c051c82-e56a-4a50-a24b-23eb2136f3ee", "name": "network-vif-deleted", "tag": "18490e88-a837-4ac8-a475-885551bb6219"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Creating event network-changed:e4d4e52c-5363-4345-9db1-022e8287c65a for instance dca3424c-cbca-4520-a495-8867c2a9c0c4 on user Apr 14 13:19:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Creating event network-vif-plugged:18490e88-a837-4ac8-a475-885551bb6219 for instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee on user Apr 14 13:19:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] Creating event network-vif-deleted:18490e88-a837-4ac8-a475-885551bb6219 for instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee on user Apr 14 13:19:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-1c54c1a9-d050-4766-85fd-fd4af8b681e4 req-6e7df08e-9bbf-4862-94c1-51b0efa1137c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.035599 Apr 14 13:19:19 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 141/428] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:19 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3424c-cbca-4520-a495-8867c2a9c0c4", "name": "network-vif-plugged", "status": "completed", "tag": "e4d4e52c-5363-4345-9db1-022e8287c65a"}, {"server_uuid": "dca3424c-cbca-4520-a495-8867c2a9c0c4", "name": "network-vif-plugged", "status": "completed", "tag": "e4d4e52c-5363-4345-9db1-022e8287c65a"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Creating event network-vif-plugged:e4d4e52c-5363-4345-9db1-022e8287c65a for instance dca3424c-cbca-4520-a495-8867c2a9c0c4 on user Apr 14 13:19:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] Creating event network-vif-plugged:e4d4e52c-5363-4345-9db1-022e8287c65a for instance dca3424c-cbca-4520-a495-8867c2a9c0c4 on user Apr 14 13:19:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-20ac6831-dfc1-4ec5-80c2-36b46a3943ed req-e68fc8fb-5f2f-48d1-ae79-f7c7e2ab4bfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057842 Apr 14 13:19:21 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 145/429] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:21 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:21 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:22 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065f23d461f44751a6911adcd3124fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b733f664b340e289c562e19ebd28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:22 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ec36d501-a9b9-47a7-b9b5-10a1506fc648 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 200 len: 1672 microversion: 2.1 time: 0.350060 Apr 14 13:19:22 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 144/430] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:21 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 1672 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:23 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ce7f6838-e851-410e-9cc9-6040d0b562d3 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f" status: 200 len: 1494 microversion: 2.1 time: 0.264424 Apr 14 13:19:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 142/431] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:23 2023] GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f => generated 1494 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=10 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5cb1d40-77ed-4de5-b20c-c574e4ef2507"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-69c70301-7b9b-419f-ac85-8b4325df770a tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "POST /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.333495 Apr 14 13:19:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 146/432] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:19:24 2023] POST /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] [instance: c74c3463-6701-4150-9096-1775785e8e2a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:31 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] HTTP exception thrown: Instance c74c3463-6701-4150-9096-1775785e8e2a could not be found. Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Request method failure captured: Apr 14 13:19:31 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a HTTP/1.1 Apr 14 13:19:31 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:19:31 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:19:31 user devstack@n-api.service[61774]: Connection: close Apr 14 13:19:31 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:19:31 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:19:31 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:19:31 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:19:31 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVEyzZ3V79Pxe2dv4GDgoNjEX-apnTirRRCxEpfYsn6-W01U9z9l-wCxcQkvKRVlGutB0KtnzNDXiBQ84YIOlq8uENHkfXCNv371UvaotOeq7P53URwGpaB8XiKZyRlr5qYs_pPnvQYUo3uDN4iyM9e4TSM5Uyrmm8Dp9_D4c3eHazA Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Project-Id: 9094bc9720194f02abdc6d0b081c7e32 Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Project-Name: tempest-VolumesAdminNegativeTest-1303459042 Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9094bc9720194f02abdc6d0b081c7e32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9094bc9720194f02abdc6d0b081c7e32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9094bc9720194f02abdc6d0b081c7e32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Tenant: tempest-VolumesAdminNegativeTest-1303459042 Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Tenant-Id: 9094bc9720194f02abdc6d0b081c7e32 Apr 14 13:19:31 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1303459042 Apr 14 13:19:31 user devstack@n-api.service[61774]: X-User: tempest-VolumesAdminNegativeTest-1303459042-project-member Apr 14 13:19:31 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:19:31 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:19:31 user devstack@n-api.service[61774]: X-User-Id: f1387c0adbe74072b52886ddc2af4182 Apr 14 13:19:31 user devstack@n-api.service[61774]: X-User-Name: tempest-VolumesAdminNegativeTest-1303459042-project-member Apr 14 13:19:31 user devstack@n-api.service[61774]: method: > Apr 14 13:19:31 user devstack@n-api.service[61774]: exception: Instance c74c3463-6701-4150-9096-1775785e8e2a could not be found. Apr 14 13:19:31 user devstack@n-api.service[61774]: action_args: {'id': 'c74c3463-6701-4150-9096-1775785e8e2a'} Apr 14 13:19:31 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74c3463-6701-4150-9096-1775785e8e2a could not be found. Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74c3463-6701-4150-9096-1775785e8e2a could not be found. Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74c3463-6701-4150-9096-1775785e8e2a could not be found. Apr 14 13:19:31 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:31 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Returning 404 to user: Instance c74c3463-6701-4150-9096-1775785e8e2a could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:19:31 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6d1ed0b9-9a32-4256-bbe3-7d1834981553 tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a" status: 404 len: 111 microversion: 2.1 time: 0.035760 Apr 14 13:19:31 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 145/433] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:31 2023] GET /compute/v2.1/servers/c74c3463-6701-4150-9096-1775785e8e2a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:19:31 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:31 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-481ca97f-fe2c-49b4-9dce-797b3532415a tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] Calling method '.version_select at 0x7fa743a34040>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:31 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-481ca97f-fe2c-49b4-9dce-797b3532415a tempest-VolumesAdminNegativeTest-1303459042 tempest-VolumesAdminNegativeTest-1303459042-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482581034" status: 202 len: 0 microversion: 2.1 time: 0.097997 Apr 14 13:19:31 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 143/434] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:19:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482581034 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "2bbf35e4-1378-46df-84f2-f839983f7fd6"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:32 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'flavor' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:19:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ed22bbfa-cdc7-4b7a-8e96-5e357e36df8b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "POST /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/action" status: 200 len: 29 microversion: 2.1 time: 0.237006 Apr 14 13:19:33 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 147/435] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:19:32 2023] POST /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/action => generated 29 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:33 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065f23d461f44751a6911adcd3124fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b733f664b340e289c562e19ebd28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:33 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-00fd732d-716e-4ecb-a2b9-418fbd01c70b tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 200 len: 1724 microversion: 2.1 time: 0.561978 Apr 14 13:19:33 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 146/436] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:33 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 1724 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:34 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:34 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-unplugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:34 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] Creating event network-vif-unplugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:19:34 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-4ba5e9b0-76a4-4d80-a0ee-8e4fab507b84 req-7234512f-7605-458c-bace-5ec0d92c4773 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081890 Apr 14 13:19:34 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 144/437] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:35 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:35 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-510001db-4ecd-40d1-8beb-dc27bed04038 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.466601 Apr 14 13:19:35 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 148/438] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 13:19:35 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-interface => generated 282 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:19:36 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:36 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:36 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:19:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-cd865192-280f-4a20-b29c-552cab74d409 req-0e2378ac-f953-467a-b134-da0f57903221 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062005 Apr 14 13:19:36 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 147/439] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] Creating event network-changed:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-906e395e-13d7-480f-b86a-9fc5f690ad05 req-5675d29a-aac1-4011-90d6-275aacc9c879 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066042 Apr 14 13:19:37 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 145/440] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-a94eda9d-b798-40dd-8f1e-e38c61e0e148 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/ips" status: 200 len: 109 microversion: 2.20 time: 0.056235 Apr 14 13:19:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 149/441] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 13:19:37 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/ips => generated 109 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:37 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:19:37 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c070cbc0-66de-4ef8-8cf9-aef726a8b80d tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754" status: 204 len: 0 microversion: 2.1 time: 0.187069 Apr 14 13:19:37 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 148/442] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:19:37 2023] DELETE /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e5ef7-70a6-449b-bc05-ff1d80465754", "name": "network-vif-unplugged", "status": "completed", "tag": "697153ca-2b37-46af-a0d3-7624fea31022"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:38 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] Creating event network-vif-unplugged:697153ca-2b37-46af-a0d3-7624fea31022 for instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 on user Apr 14 13:19:38 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-5c329bfd-fc0e-4301-b564-8cb9bbc0d1ec req-c3e4e62f-1146-4cde-85d6-12da60db3466 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062009 Apr 14 13:19:38 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 150/443] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:38 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2272cf2bf2f148e59dd600921894bb65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50c008548ed42bbaffac5876989b3a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-f85826af-1d90-48f5-93ee-cdce730e528b tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754" status: 200 len: 1492 microversion: 2.1 time: 0.467722 Apr 14 13:19:38 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 146/444] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:37 2023] GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754 => generated 1492 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:39 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e5ef7-70a6-449b-bc05-ff1d80465754", "name": "network-vif-deleted", "tag": "697153ca-2b37-46af-a0d3-7624fea31022"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] Creating event network-vif-deleted:697153ca-2b37-46af-a0d3-7624fea31022 for instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 on user Apr 14 13:19:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-38dec9db-e085-4eaf-8a54-b929eb8acc58 req-5d7d8971-a56f-40c0-843c-75833ac9e18f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030166 Apr 14 13:19:39 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 149/445] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:40 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9e5ef7-70a6-449b-bc05-ff1d80465754", "name": "network-vif-plugged", "status": "completed", "tag": "697153ca-2b37-46af-a0d3-7624fea31022"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] Creating event network-vif-plugged:697153ca-2b37-46af-a0d3-7624fea31022 for instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 on user Apr 14 13:19:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-8aeaaed3-ebf0-44cc-a040-b64bbdc526b0 req-d797bcc7-9b0c-4c3f-8e61-04b3bd5206be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029221 Apr 14 13:19:40 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 151/446] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:40 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:40 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:19:40 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-4004f86c-2f78-4603-b4f1-ddf5f13853e4 req-4ee748c3-2cf8-4976-9b47-74e7f5cc846e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033599 Apr 14 13:19:40 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 147/447] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:40 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'flavor' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:19:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c3f34612-7e97-43e6-a8f6-de533cf315ee tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/action" status: 202 len: 0 microversion: 2.20 time: 1.061598 Apr 14 13:19:41 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 150/448] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:19:40 2023] POST /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/action => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:41 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:41 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-6440ad09-0e16-491a-b5d8-35346e0c7b20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 200 len: 1712 microversion: 2.20 time: 0.313365 Apr 14 13:19:41 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 152/449] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:19:41 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 1712 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:19:42 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}, {"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-unplugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:19:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] Creating event network-vif-unplugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:19:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-a5588296-b8a1-47f6-9120-dc380ecc8573 req-8dcd8dbd-30ef-4c8f-9e4a-910634d55ad3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037998 Apr 14 13:19:42 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 148/450] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:42 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-512b6b55-3ea2-4ebd-8c3a-9a3a7f02213c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Action: 'create', calling method: .version_select at 0x7fa7438305e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-671378317"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-512b6b55-3ea2-4ebd-8c3a-9a3a7f02213c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.425248 Apr 14 13:19:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 151/451] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 13:19:43 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 13:19:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-8306bd32-8e62-4445-af0d-d6725e607efa tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743979bd0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:19:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-d39f8708-afad-43e1-a5b2-7eb9bc50aee9 req-a504e603-dd63-4212-ab8b-c85287a005ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038897 Apr 14 13:19:44 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 153/452] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-8306bd32-8e62-4445-af0d-d6725e607efa tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 200 len: 344 microversion: 2.1 time: 0.109967 Apr 14 13:19:44 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 149/453] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:19:44 2023] GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 344 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:45 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1188690873", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:45 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] validate_networks() for [('5bb34665-b8a7-4eb1-a250-c5b7ca33f499', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:19:45 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-09d3d005-65a8-4491-b4c7-ec28dd9a119b tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743a02320>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-09d3d005-65a8-4491-b4c7-ec28dd9a119b tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 200 len: 344 microversion: 2.1 time: 0.082515 Apr 14 13:19:45 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 154/454] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:19:45 2023] GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting quotas for project a573d19b775642bba2f2883e0005492d. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting quotas for user ebc2d46bc1794568841df20b046356c7 and project a573d19b775642bba2f2883e0005492d. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:19:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-d07c998c-4450-48a8-b3ef-5f947a45b0be tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.949527 Apr 14 13:19:46 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 152/455] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 13:19:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:19:46 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1134538c-fc5a-4159-b781-b0dc79c3f2e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:46 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-1134538c-fc5a-4159-b781-b0dc79c3f2e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:46 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-1134538c-fc5a-4159-b781-b0dc79c3f2e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:46 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-1134538c-fc5a-4159-b781-b0dc79c3f2e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:46 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-1134538c-fc5a-4159-b781-b0dc79c3f2e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-1134538c-fc5a-4159-b781-b0dc79c3f2e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 200 len: 1395 microversion: 2.87 time: 0.083971 Apr 14 13:19:46 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 150/456] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:19:46 2023] GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 1395 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:19:46 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-48b6d11c-2ecf-4b07-88ac-fbd48d41dcb4 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743930820>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:46 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-48b6d11c-2ecf-4b07-88ac-fbd48d41dcb4 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 200 len: 345 microversion: 2.1 time: 0.057825 Apr 14 13:19:46 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 155/457] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:19:46 2023] GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-d65116be-25e2-421b-9186-482ce4c02ded tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Action: 'create', calling method: .version_select at 0x7fa7439c1090>, body: {"snapshot": {"volume_id": "f79680bd-045b-4491-84bb-e744e28f655d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1577217257"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-d65116be-25e2-421b-9186-482ce4c02ded tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.193517 Apr 14 13:19:46 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 153/458] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 13:19:46 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:46 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d7e7fef8-ea95-4a3f-a721-75f6791080ae tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743978820>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d7e7fef8-ea95-4a3f-a721-75f6791080ae tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 200 len: 287 microversion: 2.1 time: 0.049213 Apr 14 13:19:46 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 151/459] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:46 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:46 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f5dab387-f7fc-43c8-b1e3-c2847a124437 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743a02320>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:46 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f5dab387-f7fc-43c8-b1e3-c2847a124437 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.056321 Apr 14 13:19:46 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 156/460] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 13:19:46 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-81c3a923-4454-468e-9099-f08e7245d7fb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa7439c2050>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-81c3a923-4454-468e-9099-f08e7245d7fb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 200 len: 287 microversion: 2.1 time: 0.045035 Apr 14 13:19:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 154/461] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:46 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] Creating event network-changed:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:19:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-dd17ccb8-c31b-47dc-86a7-ef9451450d60 req-be51404c-0783-40cf-8829-cf81fc6c5b12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045447 Apr 14 13:19:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 152/462] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:48 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-8ea04b57-fa0f-4840-8c2b-c082a40f62e5 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743930af0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:48 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-8ea04b57-fa0f-4840-8c2b-c082a40f62e5 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 200 len: 287 microversion: 2.1 time: 0.037055 Apr 14 13:19:48 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 157/463] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:48 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:19:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-087e59b9-373d-423f-972c-ef8d28a572e9 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa7439c16c0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-087e59b9-373d-423f-972c-ef8d28a572e9 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 200 len: 287 microversion: 2.1 time: 0.037544 Apr 14 13:19:49 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 155/464] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:49 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:49 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:19:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] Creating event network-changed:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:19:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-4d56a9fe-d467-4cd4-8694-426a5f2cac74 req-eaed4876-250d-4e45-85a9-6e271eecdd5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032218 Apr 14 13:19:49 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 153/465] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:50 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2116343d-5666-4872-b2a9-d7f9f760e64c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743d07be0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2116343d-5666-4872-b2a9-d7f9f760e64c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 200 len: 288 microversion: 2.1 time: 0.040450 Apr 14 13:19:50 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 158/466] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:50 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:50 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ee85f5a1-5b89-4754-b6c8-bda839bf8560 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743a83c70>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:50 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ee85f5a1-5b89-4754-b6c8-bda839bf8560 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 202 len: 0 microversion: 2.1 time: 0.069288 Apr 14 13:19:50 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 156/467] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 13:19:50 2023] DELETE /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:19:50 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-be034a45-b2c9-41f1-a951-ab51e6face4d tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743be85e0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:50 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-be034a45-b2c9-41f1-a951-ab51e6face4d tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 200 len: 287 microversion: 2.1 time: 0.040377 Apr 14 13:19:50 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 154/468] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:50 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:51 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-427f69a3-dd31-498e-bbdb-7f2fcf0dae32 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743930e50>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:51 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-427f69a3-dd31-498e-bbdb-7f2fcf0dae32 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 200 len: 287 microversion: 2.1 time: 0.037089 Apr 14 13:19:51 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 159/469] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:51 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-232af9ca-88cb-4f2a-a93a-9e4464d7f353 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa7439c37f0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-232af9ca-88cb-4f2a-a93a-9e4464d7f353 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 200 len: 287 microversion: 2.1 time: 0.036497 Apr 14 13:19:52 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 157/470] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:52 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:19:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b12ac24f-63c5-4f2b-ac0d-f6c2ecc96d04 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743a35990>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-b12ac24f-63c5-4f2b-ac0d-f6c2ecc96d04 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] HTTP exception thrown: Snapshot dc5206dc-0f15-4e3e-b488-e219a7af65e1 could not be found. Apr 14 13:19:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b12ac24f-63c5-4f2b-ac0d-f6c2ecc96d04 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Request method failure captured: Apr 14 13:19:53 user devstack@n-api.service[61775]: request: GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 HTTP/1.1 Apr 14 13:19:53 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:19:53 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:19:53 user devstack@n-api.service[61775]: Connection: close Apr 14 13:19:53 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:19:53 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:19:53 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:19:53 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:19:53 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVLv9anV0gxyBoMmlhPffya1sKDMkC8IsgRf5eFunH_ManbnrxyDqSiMofZTj7XXffMx-Y5DYzHOMAVGkx4XB0agKfmS_OIUoXCypIbSUi6rKagsNkFzkT9JCpSDRuYsFiDxJB3AX9VJfaNgtgx_1JFQkOzT23Q_4qObp66FjXHjh9g Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Project-Id: 7aa5edc864114382a2204241c45266ca Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7aa5edc864114382a2204241c45266ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7aa5edc864114382a2204241c45266ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7aa5edc864114382a2204241c45266ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Tenant: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Tenant-Id: 7aa5edc864114382a2204241c45266ca Apr 14 13:19:53 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:53 user devstack@n-api.service[61775]: X-User: tempest-VolumesSnapshotsTestJSON-253271212-project-member Apr 14 13:19:53 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:19:53 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:19:53 user devstack@n-api.service[61775]: X-User-Id: 2c66690caeef43eabeb3c973020d0531 Apr 14 13:19:53 user devstack@n-api.service[61775]: X-User-Name: tempest-VolumesSnapshotsTestJSON-253271212-project-member Apr 14 13:19:53 user devstack@n-api.service[61775]: method: Apr 14 13:19:53 user devstack@n-api.service[61775]: exception: Snapshot dc5206dc-0f15-4e3e-b488-e219a7af65e1 could not be found. Apr 14 13:19:53 user devstack@n-api.service[61775]: action_args: {'id': 'dc5206dc-0f15-4e3e-b488-e219a7af65e1'} Apr 14 13:19:53 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dc5206dc-0f15-4e3e-b488-e219a7af65e1 could not be found. (HTTP 404) (Request-ID: req-911efc85-50b0-47e8-acd6-55e1a01b530b) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dc5206dc-0f15-4e3e-b488-e219a7af65e1 could not be found. Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dc5206dc-0f15-4e3e-b488-e219a7af65e1 could not be found. Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dc5206dc-0f15-4e3e-b488-e219a7af65e1 could not be found. Apr 14 13:19:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b12ac24f-63c5-4f2b-ac0d-f6c2ecc96d04 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Returning 404 to user: Snapshot dc5206dc-0f15-4e3e-b488-e219a7af65e1 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:19:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b12ac24f-63c5-4f2b-ac0d-f6c2ecc96d04 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1" status: 404 len: 111 microversion: 2.1 time: 0.038015 Apr 14 13:19:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 155/471] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 13:19:53 2023] GET /compute/v2.1/os-snapshots/dc5206dc-0f15-4e3e-b488-e219a7af65e1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:19:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ae57a865-d559-4899-a93c-a3e605ae0cdb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743b877f0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ae57a865-d559-4899-a93c-a3e605ae0cdb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 202 len: 0 microversion: 2.1 time: 0.062713 Apr 14 13:19:53 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 160/472] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:19:53 2023] DELETE /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:19:53 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-abba68c3-ec39-4719-9cf2-5b76ffd15a9f tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa7439c00d0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-abba68c3-ec39-4719-9cf2-5b76ffd15a9f tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 200 len: 344 microversion: 2.1 time: 0.053439 Apr 14 13:19:53 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 158/473] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:19:53 2023] GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:54 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0e24e82b-9264-459d-b8c0-a8dd751e655d tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743a35fc0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0e24e82b-9264-459d-b8c0-a8dd751e655d tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 200 len: 344 microversion: 2.1 time: 0.060812 Apr 14 13:19:54 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 156/474] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:19:54 2023] GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=11 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=19 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:55 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0868a82043f44a7bc91fc8c6785dc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea4bc3b35746889e1f72cd621d501b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:55 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-521497d8-f8d8-4d74-860a-7ba4b87315e9 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec" status: 200 len: 1455 microversion: 2.1 time: 0.263159 Apr 14 13:19:55 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 161/475] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:55 2023] GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec => generated 1455 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:19:55 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7c95b0f3-e89c-4abe-97e5-2531fbe08d2e tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa7439c1d80>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7c95b0f3-e89c-4abe-97e5-2531fbe08d2e tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 200 len: 344 microversion: 2.1 time: 0.055785 Apr 14 13:19:55 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 159/476] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:19:55 2023] GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:19:56 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-48082730-ed0a-4cd3-b0b6-173025d5f46c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743ba32e0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-48082730-ed0a-4cd3-b0b6-173025d5f46c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] HTTP exception thrown: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-48082730-ed0a-4cd3-b0b6-173025d5f46c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Request method failure captured: Apr 14 13:19:56 user devstack@n-api.service[61775]: request: GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d HTTP/1.1 Apr 14 13:19:56 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:19:56 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:19:56 user devstack@n-api.service[61775]: Connection: close Apr 14 13:19:56 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:19:56 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:19:56 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:19:56 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:19:56 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVLv9anV0gxyBoMmlhPffya1sKDMkC8IsgRf5eFunH_ManbnrxyDqSiMofZTj7XXffMx-Y5DYzHOMAVGkx4XB0agKfmS_OIUoXCypIbSUi6rKagsNkFzkT9JCpSDRuYsFiDxJB3AX9VJfaNgtgx_1JFQkOzT23Q_4qObp66FjXHjh9g Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Project-Id: 7aa5edc864114382a2204241c45266ca Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7aa5edc864114382a2204241c45266ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7aa5edc864114382a2204241c45266ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7aa5edc864114382a2204241c45266ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Tenant: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Tenant-Id: 7aa5edc864114382a2204241c45266ca Apr 14 13:19:56 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61775]: X-User: tempest-VolumesSnapshotsTestJSON-253271212-project-member Apr 14 13:19:56 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:19:56 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:19:56 user devstack@n-api.service[61775]: X-User-Id: 2c66690caeef43eabeb3c973020d0531 Apr 14 13:19:56 user devstack@n-api.service[61775]: X-User-Name: tempest-VolumesSnapshotsTestJSON-253271212-project-member Apr 14 13:19:56 user devstack@n-api.service[61775]: method: Apr 14 13:19:56 user devstack@n-api.service[61775]: exception: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61775]: action_args: {'id': 'f79680bd-045b-4491-84bb-e744e28f655d'} Apr 14 13:19:56 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. (HTTP 404) (Request-ID: req-c1f11fe6-4dfd-414f-9189-2eeb8ab58e06) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-48082730-ed0a-4cd3-b0b6-173025d5f46c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Returning 404 to user: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:19:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-48082730-ed0a-4cd3-b0b6-173025d5f46c tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 404 len: 109 microversion: 2.1 time: 0.052537 Apr 14 13:19:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 157/477] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:19:56 2023] GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:19:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6a007f1d-f4bb-4e06-b4cd-844c90be6edb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743c200d0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-6a007f1d-f4bb-4e06-b4cd-844c90be6edb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] HTTP exception thrown: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6a007f1d-f4bb-4e06-b4cd-844c90be6edb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Request method failure captured: Apr 14 13:19:56 user devstack@n-api.service[61776]: request: DELETE /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d HTTP/1.1 Apr 14 13:19:56 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:19:56 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:19:56 user devstack@n-api.service[61776]: Connection: close Apr 14 13:19:56 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:19:56 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:19:56 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:19:56 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:19:56 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVLv9anV0gxyBoMmlhPffya1sKDMkC8IsgRf5eFunH_ManbnrxyDqSiMofZTj7XXffMx-Y5DYzHOMAVGkx4XB0agKfmS_OIUoXCypIbSUi6rKagsNkFzkT9JCpSDRuYsFiDxJB3AX9VJfaNgtgx_1JFQkOzT23Q_4qObp66FjXHjh9g Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Project-Id: 7aa5edc864114382a2204241c45266ca Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7aa5edc864114382a2204241c45266ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7aa5edc864114382a2204241c45266ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7aa5edc864114382a2204241c45266ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Tenant-Id: 7aa5edc864114382a2204241c45266ca Apr 14 13:19:56 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61776]: X-User: tempest-VolumesSnapshotsTestJSON-253271212-project-member Apr 14 13:19:56 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:19:56 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:19:56 user devstack@n-api.service[61776]: X-User-Id: 2c66690caeef43eabeb3c973020d0531 Apr 14 13:19:56 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesSnapshotsTestJSON-253271212-project-member Apr 14 13:19:56 user devstack@n-api.service[61776]: method: Apr 14 13:19:56 user devstack@n-api.service[61776]: exception: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61776]: action_args: {'id': 'f79680bd-045b-4491-84bb-e744e28f655d'} Apr 14 13:19:56 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. (HTTP 404) (Request-ID: req-7a62be40-3269-4c88-acb9-2357a0ae62a3) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6a007f1d-f4bb-4e06-b4cd-844c90be6edb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Returning 404 to user: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:19:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-6a007f1d-f4bb-4e06-b4cd-844c90be6edb tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 404 len: 109 microversion: 2.1 time: 0.051381 Apr 14 13:19:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 162/478] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:19:56 2023] DELETE /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:19:56 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:56 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:56 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:56 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c32fef78-a2b5-49c3-8703-125240663bd7 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Calling method '.version_select at 0x7fa743831ab0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-c32fef78-a2b5-49c3-8703-125240663bd7 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] HTTP exception thrown: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c32fef78-a2b5-49c3-8703-125240663bd7 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Request method failure captured: Apr 14 13:19:56 user devstack@n-api.service[61774]: request: GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d HTTP/1.1 Apr 14 13:19:56 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:19:56 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:19:56 user devstack@n-api.service[61774]: Connection: close Apr 14 13:19:56 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:19:56 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:19:56 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:19:56 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:19:56 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVLv9anV0gxyBoMmlhPffya1sKDMkC8IsgRf5eFunH_ManbnrxyDqSiMofZTj7XXffMx-Y5DYzHOMAVGkx4XB0agKfmS_OIUoXCypIbSUi6rKagsNkFzkT9JCpSDRuYsFiDxJB3AX9VJfaNgtgx_1JFQkOzT23Q_4qObp66FjXHjh9g Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Project-Id: 7aa5edc864114382a2204241c45266ca Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7aa5edc864114382a2204241c45266ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7aa5edc864114382a2204241c45266ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7aa5edc864114382a2204241c45266ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Tenant: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Tenant-Id: 7aa5edc864114382a2204241c45266ca Apr 14 13:19:56 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-253271212 Apr 14 13:19:56 user devstack@n-api.service[61774]: X-User: tempest-VolumesSnapshotsTestJSON-253271212-project-member Apr 14 13:19:56 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:19:56 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:19:56 user devstack@n-api.service[61774]: X-User-Id: 2c66690caeef43eabeb3c973020d0531 Apr 14 13:19:56 user devstack@n-api.service[61774]: X-User-Name: tempest-VolumesSnapshotsTestJSON-253271212-project-member Apr 14 13:19:56 user devstack@n-api.service[61774]: method: Apr 14 13:19:56 user devstack@n-api.service[61774]: exception: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61774]: action_args: {'id': 'f79680bd-045b-4491-84bb-e744e28f655d'} Apr 14 13:19:56 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. (HTTP 404) (Request-ID: req-3f32688a-ec7c-4ddb-a31a-b39c65eff70e) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. Apr 14 13:19:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:19:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c32fef78-a2b5-49c3-8703-125240663bd7 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] Returning 404 to user: Volume f79680bd-045b-4491-84bb-e744e28f655d could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:19:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c32fef78-a2b5-49c3-8703-125240663bd7 tempest-VolumesSnapshotsTestJSON-253271212 tempest-VolumesSnapshotsTestJSON-253271212-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d" status: 404 len: 109 microversion: 2.1 time: 0.047377 Apr 14 13:19:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 160/479] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:19:56 2023] GET /compute/v2.1/os-volumes/f79680bd-045b-4491-84bb-e744e28f655d => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=17 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=18 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:19:59 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:19:59 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-97c34467-6949-4ed7-9eb9-c683ffd0738c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 200 len: 1503 microversion: 2.1 time: 0.264934 Apr 14 13:19:59 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 158/480] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:19:59 2023] GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:00 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:00 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:20:00 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-fb0183e2-b085-44f9-98fc-9a4664f420f5 req-a7178976-060f-4350-a011-598e9f2b7300 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037375 Apr 14 13:20:00 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 163/481] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:20:02 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:02 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:02 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:02 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:02 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:20:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-ec22dbcb-7334-4e84-a120-89869b57bfea req-685540d2-af11-4e32-940f-ecee4a236164 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044184 Apr 14 13:20:03 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 161/482] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:03 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ee4da97d-c8ef-48b2-8954-1c6f1c24d0b5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1657 microversion: 2.1 time: 0.250743 Apr 14 13:20:03 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 159/483] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:03 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1657 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:03 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ac8af806-5b11-4212-9de1-47c469d764ed tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1657 microversion: 2.1 time: 0.215611 Apr 14 13:20:03 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 164/484] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:03 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1657 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:04 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:04 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c280bf75-5ff7-4f60-bc7f-38f3c5f3992c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4" status: 200 len: 1544 microversion: 2.1 time: 0.261420 Apr 14 13:20:04 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 162/485] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:04 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 => generated 1544 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] [instance: 2c051c82-e56a-4a50-a24b-23eb2136f3ee] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] HTTP exception thrown: Instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee could not be found. Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Request method failure captured: Apr 14 13:20:05 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee HTTP/1.1 Apr 14 13:20:05 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:20:05 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:20:05 user devstack@n-api.service[61775]: Connection: close Apr 14 13:20:05 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:20:05 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:20:05 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:20:05 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:20:05 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVF1Ko7briIYDDINOI3S39KFh0nutIq4dMFgHRsQz_pegxJxOHqgyWRnx2xL_w_Nm5dTJS1pYitFcOB0brfKBmVoJ9Nq90tD2Mzk22yJqVulYlKmaHcfJ4IertbMQbJplgwUzeHNC9sXaifRFSEcNCzHg0p-bam6yME-MEN7ctKZ3AY Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Project-Id: 4fe64d1d65224162b60849eace352cb4 Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1137775211 Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4fe64d1d65224162b60849eace352cb4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fe64d1d65224162b60849eace352cb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4fe64d1d65224162b60849eace352cb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Tenant: tempest-VolumesSnapshotTestJSON-1137775211 Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Tenant-Id: 4fe64d1d65224162b60849eace352cb4 Apr 14 13:20:05 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1137775211 Apr 14 13:20:05 user devstack@n-api.service[61775]: X-User: tempest-VolumesSnapshotTestJSON-1137775211-project-member Apr 14 13:20:05 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:20:05 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:20:05 user devstack@n-api.service[61775]: X-User-Id: 0f3445d14b0a44fd999bc2fc875c77bb Apr 14 13:20:05 user devstack@n-api.service[61775]: X-User-Name: tempest-VolumesSnapshotTestJSON-1137775211-project-member Apr 14 13:20:05 user devstack@n-api.service[61775]: method: > Apr 14 13:20:05 user devstack@n-api.service[61775]: exception: Instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee could not be found. Apr 14 13:20:05 user devstack@n-api.service[61775]: action_args: {'id': '2c051c82-e56a-4a50-a24b-23eb2136f3ee'} Apr 14 13:20:05 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee could not be found. Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee could not be found. Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee could not be found. Apr 14 13:20:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:20:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] Returning 404 to user: Instance 2c051c82-e56a-4a50-a24b-23eb2136f3ee could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:20:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-22043361-f368-4256-b51a-b2b7e4c8b1e0 tempest-VolumesSnapshotTestJSON-1137775211 tempest-VolumesSnapshotTestJSON-1137775211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee" status: 404 len: 111 microversion: 2.1 time: 0.033915 Apr 14 13:20:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 160/486] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:05 2023] GET /compute/v2.1/servers/2c051c82-e56a-4a50-a24b-23eb2136f3ee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:20:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:05 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Going to try to start instance {{(pid=61776) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 13:20:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-54d6c171-1041-4b79-8d7c-2aa9267adb29 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/action" status: 202 len: 0 microversion: 2.1 time: 0.110538 Apr 14 13:20:05 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 165/487] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:20:05 2023] POST /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:05 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:06 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-0ea99cba-721e-455b-984f-e2cc461fd850 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1651 microversion: 2.1 time: 0.345480 Apr 14 13:20:06 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 163/488] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:05 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1651 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:20:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-a6c1de05-434a-47c7-b08b-da8c5ec71588 req-b71d0eeb-8dea-456c-994e-99d4bae320c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030436 Apr 14 13:20:08 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 161/489] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:20:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:20:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-c682d603-0f8a-4d18-88b5-8a9bac5145e7 req-2e853226-5d41-4d27-ac14-5818243b16c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032349 Apr 14 13:20:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 166/490] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=8 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=16 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=14 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:23 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:20:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e37ce8b4-d766-44b1-9514-58ea965eeae6 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f" status: 204 len: 0 microversion: 2.1 time: 0.142691 Apr 14 13:20:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 162/491] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:20:23 2023] DELETE /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=10 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:24 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065f23d461f44751a6911adcd3124fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b733f664b340e289c562e19ebd28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1a9a6e6f-1e8d-41bc-9690-e2f897cac97c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 200 len: 1704 microversion: 2.1 time: 0.384636 Apr 14 13:20:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 164/492] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:23 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 1704 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:24 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:24 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-bb8efd7d-4a6d-43f4-ad59-32bf2d31019a tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f" status: 200 len: 1500 microversion: 2.1 time: 0.283656 Apr 14 13:20:24 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 167/493] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:23 2023] GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f => generated 1500 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:24 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e06aa11-247c-48ff-adc2-f321e6c72f1f", "name": "network-vif-unplugged", "status": "completed", "tag": "5a229da1-537f-4dce-b171-39cf5b5cd438"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] Creating event network-vif-unplugged:5a229da1-537f-4dce-b171-39cf5b5cd438 for instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f on user Apr 14 13:20:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-8a44464f-9c42-4a1d-b93a-b03230037473 req-640fc16f-1ffe-4ceb-ae92-70d4db15ed38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038486 Apr 14 13:20:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 163/494] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:20:26 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e06aa11-247c-48ff-adc2-f321e6c72f1f", "name": "network-vif-plugged", "status": "completed", "tag": "5a229da1-537f-4dce-b171-39cf5b5cd438"}, {"server_uuid": "1e06aa11-247c-48ff-adc2-f321e6c72f1f", "name": "network-vif-deleted", "tag": "5a229da1-537f-4dce-b171-39cf5b5cd438"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Creating event network-vif-plugged:5a229da1-537f-4dce-b171-39cf5b5cd438 for instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f on user Apr 14 13:20:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] Creating event network-vif-deleted:5a229da1-537f-4dce-b171-39cf5b5cd438 for instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f on user Apr 14 13:20:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-4b802ee3-96c8-430b-b801-e5caac871416 req-b79b9821-776a-4d6f-a30d-e369487cce7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031198 Apr 14 13:20:26 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 165/495] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] [instance: 7c9e5ef7-70a6-449b-bc05-ff1d80465754] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] HTTP exception thrown: Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 could not be found. Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Request method failure captured: Apr 14 13:20:28 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754 HTTP/1.1 Apr 14 13:20:28 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:20:28 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:20:28 user devstack@n-api.service[61776]: Connection: close Apr 14 13:20:28 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:20:28 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:20:28 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:20:28 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:20:28 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVJvDUjt1bvZcP9UvBeyMxfeOl8f5iLlDClRz2MYrgKc9bxR7XNblWBocaQELchsRO-2r-JB33KefaQdxWY5wbiCvsbBtB_rlti67o-ErLatGmjZuNT9LtKFTOZSN0jyQPAmXGwdq1PejPbm7GUXype5Xb07_s9vBrNjY7LEonncSpo Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Project-Id: e50c008548ed42bbaffac5876989b3a0 Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesActionsTest-2460432 Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e50c008548ed42bbaffac5876989b3a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e50c008548ed42bbaffac5876989b3a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e50c008548ed42bbaffac5876989b3a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesActionsTest-2460432 Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Tenant-Id: e50c008548ed42bbaffac5876989b3a0 Apr 14 13:20:28 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesActionsTest-2460432 Apr 14 13:20:28 user devstack@n-api.service[61776]: X-User: tempest-VolumesActionsTest-2460432-project-member Apr 14 13:20:28 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:20:28 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:20:28 user devstack@n-api.service[61776]: X-User-Id: 2272cf2bf2f148e59dd600921894bb65 Apr 14 13:20:28 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesActionsTest-2460432-project-member Apr 14 13:20:28 user devstack@n-api.service[61776]: method: > Apr 14 13:20:28 user devstack@n-api.service[61776]: exception: Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 could not be found. Apr 14 13:20:28 user devstack@n-api.service[61776]: action_args: {'id': '7c9e5ef7-70a6-449b-bc05-ff1d80465754'} Apr 14 13:20:28 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 could not be found. Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 could not be found. Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 could not be found. Apr 14 13:20:28 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:20:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] Returning 404 to user: Instance 7c9e5ef7-70a6-449b-bc05-ff1d80465754 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:20:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f2210856-45d7-4f10-b12d-df8ddd43bea3 tempest-VolumesActionsTest-2460432 tempest-VolumesActionsTest-2460432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754" status: 404 len: 111 microversion: 2.1 time: 0.042711 Apr 14 13:20:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 168/496] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:28 2023] GET /compute/v2.1/servers/7c9e5ef7-70a6-449b-bc05-ff1d80465754 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:20:31 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:31 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:32 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:32 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:32 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-5e8e51b7-bbf5-4540-8b44-c549ceb2f071 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 200 len: 1653 microversion: 2.20 time: 0.461503 Apr 14 13:20:32 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 164/497] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:20:31 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 1653 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=8 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:36 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-32a4182a-9407-4d51-8437-7178fa347076 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 200 len: 1768 microversion: 2.87 time: 0.352775 Apr 14 13:20:36 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 166/498] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:20:36 2023] GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 1768 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=8 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:55 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:20:55 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-88881a14-e100-41f7-9776-0c5480ba485c tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec" status: 204 len: 0 microversion: 2.1 time: 0.150055 Apr 14 13:20:55 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 169/499] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:20:55 2023] DELETE /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:55 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e675870-c86b-4ac2-a581-dbad2bdb71ec", "name": "network-vif-unplugged", "status": "completed", "tag": "55e6da39-5c8f-43dc-a24b-cd2e266b4752"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:55 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:55 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:20:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] Creating event network-vif-unplugged:55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec on user Apr 14 13:20:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-1c46737f-1ba8-47fe-b915-0abf88eab1ae req-db1b16c4-0e31-492a-b966-5508f80b5451 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037590 Apr 14 13:20:55 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 167/500] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:20:56 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0868a82043f44a7bc91fc8c6785dc1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcea4bc3b35746889e1f72cd621d501b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-201aa20a-0f9e-455a-905b-0280ac5a8958 tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec" status: 200 len: 1461 microversion: 2.1 time: 0.440874 Apr 14 13:20:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 165/501] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:55 2023] GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec => generated 1461 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:56 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:20:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-89c65d4a-86e1-4390-b6fa-718fc6436e71 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1655 microversion: 2.1 time: 0.323679 Apr 14 13:20:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 170/502] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:20:56 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1655 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:20:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e675870-c86b-4ac2-a581-dbad2bdb71ec", "name": "network-vif-deleted", "tag": "55e6da39-5c8f-43dc-a24b-cd2e266b4752"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] Creating event network-vif-deleted:55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec on user Apr 14 13:20:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-c44a9d9a-2b23-443a-82c7-9897a7e8ba52 req-c40864c1-0a13-4fa2-8aeb-41251cffc017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033644 Apr 14 13:20:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 168/503] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:20:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e675870-c86b-4ac2-a581-dbad2bdb71ec", "name": "network-vif-plugged", "status": "completed", "tag": "55e6da39-5c8f-43dc-a24b-cd2e266b4752"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:20:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:20:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:20:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:20:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] Creating event network-vif-plugged:55e6da39-5c8f-43dc-a24b-cd2e266b4752 for instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec on user Apr 14 13:20:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-adce51d2-401e-41e4-b186-9108b8654573 req-27d01422-fb71-4b91-aed7-cd720b7fdee3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037206 Apr 14 13:20:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 166/504] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:20:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:02 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-531e5685-23e0-4882-8544-508088606a2f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'create', calling method: .version_select at 0x7fa743e36440>, body: {"keypair": {"name": "tempest-keypair-1544885661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8A7EAZq7tmqrVNMLohBE3mL47WklU/y0g3C4awZJlk7zTwzptrakKyJKVosEv0afOebqhON5GWZWdR8IogeuUlgLuKQn8gHHZsiUBVmRBYXQ+jLuDfBW7YAbRSIevoPw=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:02 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-531e5685-23e0-4882-8544-508088606a2f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting quotas for project a7c8c8f620334166a141ea65525ba2a0. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:21:02 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-531e5685-23e0-4882-8544-508088606a2f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting quotas for user 3948b7c643374bcdbeb34f0f2f790c3c and project a7c8c8f620334166a141ea65525ba2a0. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:21:02 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-531e5685-23e0-4882-8544-508088606a2f tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065402 Apr 14 13:21:02 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 171/505] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:21:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:04 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1752142358", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a2caff26-0e2b-4e61-8af1-e13eada766a1"}], "security_groups": [{"name": "tempest-securitygroup--357605454"}], "key_name": "tempest-keypair-1544885661", "user_data": "}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:04 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:04 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] validate_networks() for [('a2caff26-0e2b-4e61-8af1-e13eada766a1', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:21:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-8f85f6c8-bab7-48f2-9a5a-177c3c75b2e0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.386799 Apr 14 13:21:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 167/506] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:21:04 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-interface => generated 282 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting quotas for project a7c8c8f620334166a141ea65525ba2a0. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Getting quotas for user 3948b7c643374bcdbeb34f0f2f790c3c and project a7c8c8f620334166a141ea65525ba2a0. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:21:05 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:21:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-43af380c-13d2-4a1c-b45e-62533d22421a tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.196177 Apr 14 13:21:05 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 169/507] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:21:04 2023] POST /compute/v2.1/servers => generated 406 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:21:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-053c37dd-b8be-423c-8c86-15578a43bb15 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:05 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-053c37dd-b8be-423c-8c86-15578a43bb15 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:05 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-053c37dd-b8be-423c-8c86-15578a43bb15 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-053c37dd-b8be-423c-8c86-15578a43bb15 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 200 len: 1240 microversion: 2.1 time: 0.093349 Apr 14 13:21:05 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 172/508] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:05 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:06 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:06 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d347d5df-0184-4fa1-b426-f10befc212c1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1657 microversion: 2.1 time: 0.472487 Apr 14 13:21:06 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 168/509] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:06 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1657 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:06 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dc33843-6235-4794-844e-9fc4db46c60e"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:06 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:07 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca3424c-cbca-4520-a495-8867c2a9c0c4", "tag": "e4d4e52c-5363-4345-9db1-022e8287c65a"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:07 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:07 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] Creating event network-changed:e4d4e52c-5363-4345-9db1-022e8287c65a for instance dca3424c-cbca-4520-a495-8867c2a9c0c4 on user Apr 14 13:21:07 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-aaa3ae1d-bba6-4f52-bc34-5014f7bcaad6 req-a65afb9f-29e9-4e25-821a-15581b9eebff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038559 Apr 14 13:21:07 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 173/510] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:07 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:07 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-865e5cae-b981-4e5e-91db-b295399bb1a0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/ips" status: 200 len: 107 microversion: 2.1 time: 0.049580 Apr 14 13:21:07 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 169/511] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:21:07 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/ips => generated 107 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-35f031bd-e393-46fb-9696-7d828a790a9b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331759 Apr 14 13:21:07 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 170/512] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:21:06 2023] POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:09 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55eed418-6cb1-4596-aad1-2a05d54e57c2"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:09 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] Creating event network-changed:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:21:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-8025f476-fa5f-4cda-8b78-b5d3b155a8e2 req-f222f384-f90f-453f-b479-e4bd17c4c581 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051636 Apr 14 13:21:09 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 170/513] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-0f260500-f83c-48c5-aa6d-2682760ea64b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400717 Apr 14 13:21:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 174/514] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:21:09 2023] POST /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:12 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:21:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-55476349-620b-4c2b-86d5-2b18cd31042e req-37a33ab2-2e86-4013-b2ae-006c44a7c865 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041902 Apr 14 13:21:12 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 171/515] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:21:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-da90b01d-430b-4e54-b99a-969900bedb54 req-7cb9a4a6-6534-4535-819a-ea263a381cf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047341 Apr 14 13:21:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 171/516] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-885871605", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "6834b709-2b53-483e-a90a-520b7a7cb4f9", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "32e04661-5709-44d8-b16f-bc45b62317fc"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] HTTP exception thrown: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Request method failure captured: Apr 14 13:21:14 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f HTTP/1.1 Apr 14 13:21:14 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:21:14 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:21:14 user devstack@n-api.service[61776]: Connection: close Apr 14 13:21:14 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:21:14 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:21:14 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:21:14 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:21:14 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVI3LyLT14ImRPIYeF6YAL3zUPp4aHdeRySuqatLcEpMh_Bcu61fTZDhqM3bjsg5-R5SaHgBHmQHjC-Xe8ZmGQ-dgPb8URDyOpCCHN4uhdgFYgCCC1jX1KH2yXZXpwHcqH1ITNDlTGk2hVOhLxkLt4q9tSMqGtjE-mav9O1H82Hlft4 Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Project-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Project-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Tenant: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Tenant-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:21:14 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:21:14 user devstack@n-api.service[61776]: X-User: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:21:14 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:21:14 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:21:14 user devstack@n-api.service[61776]: X-User-Id: 3f713f95191542f6a23ee25669061b27 Apr 14 13:21:14 user devstack@n-api.service[61776]: X-User-Name: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:21:14 user devstack@n-api.service[61776]: method: > Apr 14 13:21:14 user devstack@n-api.service[61776]: exception: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:21:14 user devstack@n-api.service[61776]: action_args: {'id': '1e06aa11-247c-48ff-adc2-f321e6c72f1f'} Apr 14 13:21:14 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:21:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Returning 404 to user: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:21:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-845cd2af-54d0-4db5-9c40-cfa5da362732 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f" status: 404 len: 111 microversion: 2.1 time: 0.037349 Apr 14 13:21:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 175/517] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:14 2023] GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] validate_networks() for [('32e04661-5709-44d8-b16f-bc45b62317fc', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:21:14 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-c0eef6b7-10fd-4b5a-a7d4-344333053321 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 200 len: 1494 microversion: 2.1 time: 0.355447 Apr 14 13:21:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 172/518] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:14 2023] GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 1494 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:14 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for user bb40413bd0c3490d97b997f69c930f72 and project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='6834b709-2b53-483e-a90a-520b7a7cb4f9',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:21:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-3eedb29b-5e37-4d72-947e-b050a23578a9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.804431 Apr 14 13:21:15 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 172/519] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:21:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:21:15 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-cc7165b1-8a8c-4135-9386-7ed8f75d6fe4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:15 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-cc7165b1-8a8c-4135-9386-7ed8f75d6fe4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:15 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-975f6e79-d3bd-47fb-8003-05acb7d6de43 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1703 microversion: 2.1 time: 0.292450 Apr 14 13:21:15 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 176/520] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:14 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1703 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:15 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-cc7165b1-8a8c-4135-9386-7ed8f75d6fe4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-cc7165b1-8a8c-4135-9386-7ed8f75d6fe4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 200 len: 1051 microversion: 2.1 time: 0.083511 Apr 14 13:21:15 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 173/521] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:15 2023] GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 1051 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1057847197", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for project 4b197f1df57f4dee9757639cf861eb97. Resources: dict_keys(['metadata_items']) {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for user 9169729edbd04fd5a74d2cffd0aa437f and project 4b197f1df57f4dee9757639cf861eb97. Resources: dict_keys(['metadata_items']) {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-194b250c-a6ba-4653-9807-b671f30d4848 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/action" status: 202 len: 1160 microversion: 2.1 time: 0.359573 Apr 14 13:21:15 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 173/522] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 13:21:15 2023] POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/action => generated 1160 bytes in 361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:15 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:15 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7de9ba58-004d-440d-a13b-7448d9661a2d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1731 microversion: 2.1 time: 0.214513 Apr 14 13:21:15 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 177/523] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:15 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1731 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:16 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-unplugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:16 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] Creating event network-vif-unplugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:21:16 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-46fc7068-97ca-4821-8e30-02a8f2ab3a47 req-a8a43f63-5b49-4076-acbb-d2c38583dcac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037120 Apr 14 13:21:16 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 174/524] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:21:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-e2f76de6-0876-4aa7-933e-ae09990d84c3 req-e16b909b-42cf-416a-ae77-66dea7cd4a65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055331 Apr 14 13:21:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 174/525] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21aa2e30-d383-4f3b-8c40-7a06968ecb8c", "tag": "4ded420e-025f-481e-85a1-010b7e3d71f7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:18 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] Creating event network-changed:4ded420e-025f-481e-85a1-010b7e3d71f7 for instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c on user Apr 14 13:21:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-d0a07100-b159-4887-aaa8-7200e72bcf84 req-f2375673-6a99-44e8-9e59-3dcab78c99ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037969 Apr 14 13:21:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 178/526] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55eed418-6cb1-4596-aad1-2a05d54e57c2"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Invalid volume: volume 55eed418-6cb1-4596-aad1-2a05d54e57c2 is already attached to instances: dca3424c-cbca-4520-a495-8867c2a9c0c4 Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:21:19 user devstack@n-api.service[61775]: request: POST /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments HTTP/1.1 Apr 14 13:21:19 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:21:19 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:21:19 user devstack@n-api.service[61775]: Connection: close Apr 14 13:21:19 user devstack@n-api.service[61775]: Content-Length: 74 Apr 14 13:21:19 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:21:19 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:21:19 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:21:19 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:21:19 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:21:19 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:21:19 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:21:19 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:21:19 user devstack@n-api.service[61775]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:21:19 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:21:19 user devstack@n-api.service[61775]: Apr 14 13:21:19 user devstack@n-api.service[61775]: {"volumeAttachment": {"volumeId": "55eed418-6cb1-4596-aad1-2a05d54e57c2"}} Apr 14 13:21:19 user devstack@n-api.service[61775]: method: > Apr 14 13:21:19 user devstack@n-api.service[61775]: exception: Invalid volume: volume 55eed418-6cb1-4596-aad1-2a05d54e57c2 is already attached to instances: dca3424c-cbca-4520-a495-8867c2a9c0c4 Apr 14 13:21:19 user devstack@n-api.service[61775]: action_args: {'server_id': 'dca3424c-cbca-4520-a495-8867c2a9c0c4', 'body': {'volumeAttachment': {'volumeId': '55eed418-6cb1-4596-aad1-2a05d54e57c2'}}} Apr 14 13:21:19 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 55eed418-6cb1-4596-aad1-2a05d54e57c2 is already attached to instances: dca3424c-cbca-4520-a495-8867c2a9c0c4 Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 55eed418-6cb1-4596-aad1-2a05d54e57c2 is already attached to instances: dca3424c-cbca-4520-a495-8867c2a9c0c4 Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 55eed418-6cb1-4596-aad1-2a05d54e57c2 is already attached to instances: dca3424c-cbca-4520-a495-8867c2a9c0c4 Apr 14 13:21:19 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:21:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 400 to user: Invalid volume: volume 55eed418-6cb1-4596-aad1-2a05d54e57c2 is already attached to instances: dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:21:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-832c30bd-0591-4b85-b9c5-0efeb73591be tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174894 Apr 14 13:21:19 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 175/527] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:21:19 2023] POST /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments => generated 174 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:19 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'services' on Instance uuid dca3424c-cbca-4520-a495-8867c2a9c0c4 {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:21:19 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ebbe12f9-2754-4523-bbf7-4117eca42e07 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments/55eed418-6cb1-4596-aad1-2a05d54e57c2" status: 202 len: 0 microversion: 2.1 time: 0.272916 Apr 14 13:21:19 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 175/528] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:21:19 2023] DELETE /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments/55eed418-6cb1-4596-aad1-2a05d54e57c2 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:21:19 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:19 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:19 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e513ca64-79ea-45e4-9ad3-2e093cea2710 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073644 Apr 14 13:21:19 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 179/529] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:21:19 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:24 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:24 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a45c3d76-1b84-4c49-8eb6-5c4f8d7c2070 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "POST /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/action" status: 202 len: 0 microversion: 2.1 time: 0.418424 Apr 14 13:21:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 176/530] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:21:24 2023] POST /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:24 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:25 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=12 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c9382858-79d5-4a3b-ba55-4059abeadb15 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.362008 Apr 14 13:21:25 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 176/531] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:21:24 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-interface => generated 283 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:26 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-unplugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:26 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] Creating event network-vif-unplugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:21:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f51b9dcf-d4cb-4dff-9eed-a03d1f940116 req-efd5aecd-507b-473f-9a0f-33551faf982c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055788 Apr 14 13:21:26 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 180/532] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:26 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:26 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:26 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=27 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:26 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] Creating event network-changed:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:21:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-3e0150b6-3952-4912-91b7-f0e76cdbdd1c req-ffedd6a9-bb08-4829-b235-40a2bacaab99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040050 Apr 14 13:21:26 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 177/533] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:28 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:28 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:28 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=6,nova_cell1:INSERT=4,nova_cell1:DELETE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:21:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-d6a77b4c-4dca-426e-8667-f8ef5472479e req-f6ad69e4-ad38-455e-ba54-b166bc3c45b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040136 Apr 14 13:21:28 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 177/534] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] Creating event network-changed:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:21:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-93b5166a-5996-4eb4-9b01-29ffbaaa3e5e req-5490fbbf-a63f-4fc8-b46d-55dd3f35575c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032300 Apr 14 13:21:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 181/535] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}, {"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:21:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:21:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-925919e2-4760-4742-9296-a1e7befd62b5 req-9fc9c790-5092-4eaf-b0dd-720e22e2ae44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042611 Apr 14 13:21:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 178/536] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:31 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21aa2e30-d383-4f3b-8c40-7a06968ecb8c", "name": "network-vif-plugged", "status": "completed", "tag": "4ded420e-025f-481e-85a1-010b7e3d71f7"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:31 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] Creating event network-vif-plugged:4ded420e-025f-481e-85a1-010b7e3d71f7 for instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c on user Apr 14 13:21:31 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-dcd7c425-13a9-474b-baf8-7cae133af7c5 req-51ddb79c-7ed0-493e-8845-66731a1bc0da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045523 Apr 14 13:21:31 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 178/537] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:32 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fe1d12d-36df-40a9-a5dd-ce6280d95839"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:32 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:32 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}, {"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:21:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:21:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-ed0bc404-a709-4989-8491-28866c7d9d2a req-10c058de-d043-4c58-ac95-d0e717e82391 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039245 Apr 14 13:21:32 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 179/538] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:32 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-613ef41b-b4b9-4473-a3db-c653384136ea tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.345765 Apr 14 13:21:32 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 182/539] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 13:21:32 2023] POST /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments => generated 188 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:32 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61774) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 13:21:33 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-929fc165-6284-462b-aead-77b3f84a2f20 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/action" status: 202 len: 0 microversion: 2.20 time: 0.228278 Apr 14 13:21:33 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 179/540] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:21:32 2023] POST /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:33 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-131c99d4-1815-4b5c-a600-29e2ca35ccdf tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 200 len: 1739 microversion: 2.20 time: 0.313462 Apr 14 13:21:33 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 180/541] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:21:33 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:21:33 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21aa2e30-d383-4f3b-8c40-7a06968ecb8c", "name": "network-vif-plugged", "status": "completed", "tag": "4ded420e-025f-481e-85a1-010b7e3d71f7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:33 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] Creating event network-vif-plugged:4ded420e-025f-481e-85a1-010b7e3d71f7 for instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c on user Apr 14 13:21:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-c47b4896-1035-41ca-b692-0b393200096d req-3ae5cc86-66a4-4a89-8f74-ecb5876a0c55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Apr 14 13:21:33 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 183/542] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "7de2a88f-446d-4847-88b8-17bd32d4d517"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:37 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'flavor' on Instance uuid b7cdf352-a517-4296-bc70-400836915095 {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:21:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-94440842-557d-44cb-937a-44271e72d752 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095/action" status: 200 len: 29 microversion: 2.87 time: 0.860226 Apr 14 13:21:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 180/543] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:21:37 2023] POST /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095/action => generated 29 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:38 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-94e108d1-5c8a-49a1-894d-9a0df5190864 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 200 len: 1774 microversion: 2.87 time: 0.367229 Apr 14 13:21:38 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 181/544] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:21:38 2023] GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 1774 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:21:39 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-unplugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:39 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] Creating event network-vif-unplugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:21:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-01eea37f-baa8-46c4-9edd-0409774bfde7 req-4509e869-cf34-4c63-bee1-534000b70e44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057230 Apr 14 13:21:39 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 184/545] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:41 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:21:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-2582392f-1717-4ac6-8995-413371d7761b req-d9eb17e2-9f86-419a-b73f-eed61ee3630e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060810 Apr 14 13:21:41 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 181/546] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] Creating event network-changed:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:21:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-50656481-4867-4eae-9ac5-a92571a6fd18 req-18b19315-7c33-4f30-ad3f-38c330e09e0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044640 Apr 14 13:21:43 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 182/547] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:21:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-787717a8-2eae-42cb-8960-8fb7bec13efb req-1acfb0a5-6275-4a68-81fc-096e89a5df62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031035 Apr 14 13:21:44 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 185/548] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] [instance: 0e675870-c86b-4ac2-a581-dbad2bdb71ec] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] HTTP exception thrown: Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec could not be found. Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Request method failure captured: Apr 14 13:21:46 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec HTTP/1.1 Apr 14 13:21:46 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:21:46 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:21:46 user devstack@n-api.service[61774]: Connection: close Apr 14 13:21:46 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:21:46 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:21:46 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:21:46 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:21:46 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVLFFzx5wQ4UO3xFFHAZQXqOduuEQ0EmulxzTCJhcjjblHwhqzV7y029BGUTMlS0gvthLmEeCUcqir6Snt-NYoxgE8-Hpx6rGh8OdyFbZOakTK6GYpZIO0XHLrE6xHvkVeiocqgTcbo-kBnc_xmJ3U9s2XWexdufPLpJtvqFKlsvrGQ Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Project-Id: fcea4bc3b35746889e1f72cd621d501b Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Project-Name: tempest-VolumesNegativeTest-1899611102 Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fcea4bc3b35746889e1f72cd621d501b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcea4bc3b35746889e1f72cd621d501b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fcea4bc3b35746889e1f72cd621d501b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Tenant: tempest-VolumesNegativeTest-1899611102 Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Tenant-Id: fcea4bc3b35746889e1f72cd621d501b Apr 14 13:21:46 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-VolumesNegativeTest-1899611102 Apr 14 13:21:46 user devstack@n-api.service[61774]: X-User: tempest-VolumesNegativeTest-1899611102-project-member Apr 14 13:21:46 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:21:46 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:21:46 user devstack@n-api.service[61774]: X-User-Id: f0868a82043f44a7bc91fc8c6785dc1e Apr 14 13:21:46 user devstack@n-api.service[61774]: X-User-Name: tempest-VolumesNegativeTest-1899611102-project-member Apr 14 13:21:46 user devstack@n-api.service[61774]: method: > Apr 14 13:21:46 user devstack@n-api.service[61774]: exception: Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec could not be found. Apr 14 13:21:46 user devstack@n-api.service[61774]: action_args: {'id': '0e675870-c86b-4ac2-a581-dbad2bdb71ec'} Apr 14 13:21:46 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec could not be found. Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec could not be found. Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec could not be found. Apr 14 13:21:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:21:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] Returning 404 to user: Instance 0e675870-c86b-4ac2-a581-dbad2bdb71ec could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:21:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-08781ed1-0216-4869-b0e9-fb1c9e860e3e tempest-VolumesNegativeTest-1899611102 tempest-VolumesNegativeTest-1899611102-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec" status: 404 len: 111 microversion: 2.1 time: 0.038949 Apr 14 13:21:46 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 182/549] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:46 2023] GET /compute/v2.1/servers/0e675870-c86b-4ac2-a581-dbad2bdb71ec => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:21:46 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:21:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-3dd5bb16-a4e6-4055-8ffc-319602473c61 req-c38342ce-3eda-4650-935f-a6756c59f319 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044725 Apr 14 13:21:46 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 183/550] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:21:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0a118b21-e1e2-4214-8156-be5fd777e807 req-f683dfe8-9e80-4d7f-94b4-3a83d4bbe968 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048150 Apr 14 13:21:54 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 186/551] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:55 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:55 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:21:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-f8164ae6-689a-47ac-94b1-0d19033c24d9 req-a9c91629-deb0-418a-9ca0-09016b8c5ef7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041604 Apr 14 13:21:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 184/552] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-eccfd103-e79a-4a4c-a6a1-95cb9fc10281 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 200 len: 1552 microversion: 2.1 time: 0.284152 Apr 14 13:21:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 183/553] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:55 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 1552 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=14 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7aca9305-b5ec-479a-9f67-d84cd7d0c6a3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053626 Apr 14 13:21:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 187/554] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:21:56 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:56 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:21:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3a318158-c6e3-4e9b-84ea-9eea6b93ec46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 204 len: 0 microversion: 2.1 time: 0.155819 Apr 14 13:21:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 185/555] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:21:56 2023] DELETE /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:57 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-unplugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] Creating event network-vif-unplugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:21:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-6c47112f-322e-47b2-9111-e580021f8116 req-807ab95d-2586-4d04-b143-f30dfe0077d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036546 Apr 14 13:21:57 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:21:57 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 188/556] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-23b658dc-5f5c-4557-b6a9-db9575f10cab tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 200 len: 1661 microversion: 2.1 time: 0.322613 Apr 14 13:21:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 184/557] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:21:56 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 1661 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:58 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lazy-loading 'services' on Instance uuid 65e98ad1-3573-4dce-b9de-bbb1c36ed02e {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:21:58 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d60ae385-f21a-4ad9-a868-7aa54ac0c5fe tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-volume_attachments/e5cb1d40-77ed-4de5-b20c-c574e4ef2507" status: 202 len: 0 microversion: 2.1 time: 0.275095 Apr 14 13:21:58 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 186/558] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:21:58 2023] DELETE /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-volume_attachments/e5cb1d40-77ed-4de5-b20c-c574e4ef2507 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:21:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:21:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:21:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f56d6ee6-d710-431d-a0c6-282341358d22 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069866 Apr 14 13:21:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 189/559] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:21:58 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-deleted", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:58 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:21:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] Creating event network-vif-deleted:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:21:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-4de24fda-c749-4145-a90a-9e593a4d3739 req-62f9ba36-841c-4f53-8783-959f8d7883fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051119 Apr 14 13:21:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 185/560] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:21:59 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bf295a-37fa-4463-bddb-38ac2c5d2cf7", "name": "network-vif-plugged", "status": "completed", "tag": "e4b573e5-ec9a-4d14-974b-d8f2bf49c980"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:21:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:21:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:21:59 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:21:59 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] Creating event network-vif-plugged:e4b573e5-ec9a-4d14-974b-d8f2bf49c980 for instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 on user Apr 14 13:21:59 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-a9683dd0-c2b9-4ffd-8d2e-147c61ef76e7 req-a9027548-b233-464d-abc9-66fffb445a7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048259 Apr 14 13:21:59 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 187/561] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:21:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:05 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7b133c03-b9c1-4c65-8ce8-cde09050760c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 200 len: 1378 microversion: 2.1 time: 0.429095 Apr 14 13:22:05 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 190/562] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:05 2023] GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 1378 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:05 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:06 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:06 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-97b182a5-635d-46af-b97e-387c9e70520f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1722 microversion: 2.1 time: 0.288760 Apr 14 13:22:06 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 186/563] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:05 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-f1fc2c63-af38-4795-b297-f5e2e647ac58 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056289 Apr 14 13:22:09 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 188/564] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:22:09 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:09 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:22:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-58c3a2d3-2b52-44d1-8d60-d6ec5bd1a74a tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4" status: 204 len: 0 microversion: 2.1 time: 0.137167 Apr 14 13:22:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 191/565] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:22:09 2023] DELETE /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:10 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-531bb935-2133-4f40-a045-f7fea8028dd0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4" status: 200 len: 1667 microversion: 2.1 time: 0.359277 Apr 14 13:22:10 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 187/566] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:10 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 => generated 1667 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:22:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3424c-cbca-4520-a495-8867c2a9c0c4", "name": "network-vif-unplugged", "status": "completed", "tag": "e4d4e52c-5363-4345-9db1-022e8287c65a"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] Creating event network-vif-unplugged:e4d4e52c-5363-4345-9db1-022e8287c65a for instance dca3424c-cbca-4520-a495-8867c2a9c0c4 on user Apr 14 13:22:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-f91f7496-72d8-4d81-a411-886ba59ebc9b req-4406d593-cd23-4dc3-9dd7-84b749fb90b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034967 Apr 14 13:22:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 189/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:12 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca3424c-cbca-4520-a495-8867c2a9c0c4", "name": "network-vif-plugged", "status": "completed", "tag": "e4d4e52c-5363-4345-9db1-022e8287c65a"}, {"server_uuid": "dca3424c-cbca-4520-a495-8867c2a9c0c4", "name": "network-vif-deleted", "tag": "e4d4e52c-5363-4345-9db1-022e8287c65a"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Creating event network-vif-plugged:e4d4e52c-5363-4345-9db1-022e8287c65a for instance dca3424c-cbca-4520-a495-8867c2a9c0c4 on user Apr 14 13:22:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] Creating event network-vif-deleted:e4d4e52c-5363-4345-9db1-022e8287c65a for instance dca3424c-cbca-4520-a495-8867c2a9c0c4 on user Apr 14 13:22:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-b062ce6f-f170-4b9a-bb32-7f608e2b6d29 req-331d1fd0-00e0-40cd-a28a-a56e06c00028 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029664 Apr 14 13:22:12 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 192/568] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c7f0c3f6-dd78-446f-a00c-a4fcb3b46d53 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-125980377", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ebe7e0c8-05bb-4916-b22c-5cf81362c7e9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "73061151-2d01-43ae-9ac6-841d71c038ba"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-c7f0c3f6-dd78-446f-a00c-a4fcb3b46d53 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] HTTP exception thrown: Block Device ebe7e0c8-05bb-4916-b22c-5cf81362c7e9 is not bootable. Apr 14 13:22:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c7f0c3f6-dd78-446f-a00c-a4fcb3b46d53 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Request method failure captured: Apr 14 13:22:17 user devstack@n-api.service[61774]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 13:22:17 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:22:17 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:22:17 user devstack@n-api.service[61774]: Connection: close Apr 14 13:22:17 user devstack@n-api.service[61774]: Content-Length: 356 Apr 14 13:22:17 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:22:17 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:22:17 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:22:17 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVI3LyLT14ImRPIYeF6YAL3zUPp4aHdeRySuqatLcEpMh_Bcu61fTZDhqM3bjsg5-R5SaHgBHmQHjC-Xe8ZmGQ-dgPb8URDyOpCCHN4uhdgFYgCCC1jX1KH2yXZXpwHcqH1ITNDlTGk2hVOhLxkLt4q9tSMqGtjE-mav9O1H82Hlft4 Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Project-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Project-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Tenant: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Tenant-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:22:17 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:22:17 user devstack@n-api.service[61774]: X-User: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:22:17 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:22:17 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:22:17 user devstack@n-api.service[61774]: X-User-Id: 3f713f95191542f6a23ee25669061b27 Apr 14 13:22:17 user devstack@n-api.service[61774]: X-User-Name: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:22:17 user devstack@n-api.service[61774]: Apr 14 13:22:17 user devstack@n-api.service[61774]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-125980377", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "ebe7e0c8-05bb-4916-b22c-5cf81362c7e9", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "73061151-2d01-43ae-9ac6-841d71c038ba"}]}} Apr 14 13:22:17 user devstack@n-api.service[61774]: method: > Apr 14 13:22:17 user devstack@n-api.service[61774]: exception: Block Device ebe7e0c8-05bb-4916-b22c-5cf81362c7e9 is not bootable. Apr 14 13:22:17 user devstack@n-api.service[61774]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-125980377', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'ebe7e0c8-05bb-4916-b22c-5cf81362c7e9'}], 'networks': [{'uuid': '73061151-2d01-43ae-9ac6-841d71c038ba'}]}}} Apr 14 13:22:17 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device ebe7e0c8-05bb-4916-b22c-5cf81362c7e9 is not bootable. Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device ebe7e0c8-05bb-4916-b22c-5cf81362c7e9 is not bootable. Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device ebe7e0c8-05bb-4916-b22c-5cf81362c7e9 is not bootable. Apr 14 13:22:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:22:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c7f0c3f6-dd78-446f-a00c-a4fcb3b46d53 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Returning 400 to user: Block Device ebe7e0c8-05bb-4916-b22c-5cf81362c7e9 is not bootable. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:22:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c7f0c3f6-dd78-446f-a00c-a4fcb3b46d53 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.078409 Apr 14 13:22:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 188/569] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:22:17 2023] POST /compute/v2.1/servers => generated 110 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:17 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-400aca13-1c59-46fd-a739-f051d510d367 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'create', calling method: .version_select at 0x7fa743932cb0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1723696496", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyN7ZXz/DhnftGXoG1DqPcVc2gONInGkCMU1F9WltEW9B7MyWX6QLuMCCaRSexfOtRkN3kvfw4EU0QaJ4W82L+01s5mIUUjLtEeLBACLFDo9jDFd26Q2mqx8aDpkmAeHQ=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:17 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-400aca13-1c59-46fd-a739-f051d510d367 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting quotas for project 9ae2e95243bc4e19b093629197fbb173. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:22:17 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-400aca13-1c59-46fd-a739-f051d510d367 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting quotas for user 9e1f366e5f9d43b9bbd8be316ddaa3a9 and project 9ae2e95243bc4e19b093629197fbb173. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:22:17 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-400aca13-1c59-46fd-a739-f051d510d367 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048403 Apr 14 13:22:17 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 193/570] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:22:17 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:17 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-58d5dc20-f69d-4b6d-9a14-19bbc52f72aa tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 200 len: 1494 microversion: 2.1 time: 0.231322 Apr 14 13:22:17 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 190/571] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:17 2023] GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 1494 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:22:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-672930101", "imageRef": "e02d2ab7-d36b-42ce-8a09-589fe97d2745", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1723696496", "networks": [{"uuid": "b9f90019-51fc-4e13-aa38-910e26bbb8d1"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:17 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] validate_networks() for [('b9f90019-51fc-4e13-aa38-910e26bbb8d1', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting quotas for project 9ae2e95243bc4e19b093629197fbb173. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting quotas for user 9e1f366e5f9d43b9bbd8be316ddaa3a9 and project 9ae2e95243bc4e19b093629197fbb173. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:22:18 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e02d2ab7-d36b-42ce-8a09-589fe97d2745',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:22:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-eded2cb2-cfb6-4f2a-9b9f-439f8987c4b5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.794338 Apr 14 13:22:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 189/572] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:22:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:22:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d7c1cb0c-8709-4407-b25e-c389eb4c5ce0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:18 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d7c1cb0c-8709-4407-b25e-c389eb4c5ce0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:18 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-d7c1cb0c-8709-4407-b25e-c389eb4c5ce0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d7c1cb0c-8709-4407-b25e-c389eb4c5ce0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1252 microversion: 2.1 time: 0.070918 Apr 14 13:22:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 194/573] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:18 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1252 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:22:21 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49467859-954f-498d-b520-587c7f38effc", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] Creating event network-changed:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:22:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-661a42e9-3743-4707-a710-2ab23ec53e58 req-8ff8aa95-e806-49df-96ee-e04cb34718ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027360 Apr 14 13:22:21 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 191/574] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:23 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:23 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-11ec8756-9772-41e1-b4a3-92f2347c3b18 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 200 len: 1784 microversion: 2.20 time: 0.239708 Apr 14 13:22:23 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 190/575] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:22:23 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 1784 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:22:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:23 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:22:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-94d93b71-a721-4d68-b4da-51a9e33786e4 req-3f123a6a-36fc-4d5e-ba88-88396ea60ddb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038743 Apr 14 13:22:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 195/576] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:25 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:22:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-14abdcd5-da01-4e9f-ac51-3fe8727ba071 req-0ae6190c-bd84-42e4-8d9b-316cb70f1c4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033962 Apr 14 13:22:25 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 192/577] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:29 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:29 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:29 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:29 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-72661ebc-4f50-40d1-be11-b5e7e63f3129 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 200 len: 1754 microversion: 2.87 time: 0.624685 Apr 14 13:22:29 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 191/578] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:22:28 2023] GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 1754 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HTTP exception thrown: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Request method failure captured: Apr 14 13:22:47 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 HTTP/1.1 Apr 14 13:22:47 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:22:47 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:22:47 user devstack@n-api.service[61776]: Connection: close Apr 14 13:22:47 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:22:47 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:22:47 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:22:47 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:22:47 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVEyICtTDp5n9aq_Z_1afPSypXpMhY0jB7yFs0dhGODD-dq5DmHr-lD12CP9OGmkVhIpxfm18Z2aW2UXW_Ghjkv3zaINayJy_ZXwX64fZ2_5kCGv7dkU8n8cuG_XwjVIV4efuCsIhmiC4Ca9qCHsD-goCAhLNYF1nJz1a5QEUv2dGUY Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Project-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Tenant-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:22:47 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:22:47 user devstack@n-api.service[61776]: X-User: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:22:47 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:22:47 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:22:47 user devstack@n-api.service[61776]: X-User-Id: d7e4e432ab0d448db8c2437e40cbe0cd Apr 14 13:22:47 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:22:47 user devstack@n-api.service[61776]: method: > Apr 14 13:22:47 user devstack@n-api.service[61776]: exception: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:22:47 user devstack@n-api.service[61776]: action_args: {'id': '84bf295a-37fa-4463-bddb-38ac2c5d2cf7'} Apr 14 13:22:47 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:22:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:22:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Returning 404 to user: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:22:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-1a16ddca-e5f0-4b99-8ca5-f838eae2ca19 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 404 len: 111 microversion: 2.1 time: 0.036358 Apr 14 13:22:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 196/579] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:47 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:22:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=10 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=18 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3cad681f-f607-4b93-b7f4-57df1d401b18 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '.version_select at 0x7fa7439a0c10>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3cad681f-f607-4b93-b7f4-57df1d401b18 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-641815070" status: 202 len: 0 microversion: 2.1 time: 0.048751 Apr 14 13:22:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 193/580] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:22:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-641815070 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:22:48 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-16c16e74-4cbb-42d8-b8bf-cc07a021d271 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'create', calling method: .version_select at 0x7fa743871990>, body: {"keypair": {"name": "tempest-keypair-531734162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKA26k0WYP8XCfCvBrpz4NFr3gf94+RBw4IFB1YpeSMcv8eoVWhtwKyWANDeja3cxf2gVPhnwh2tbJr3VvhOmIT9iaH6e76r9kQFye1uFeSzTKshoLyYKFXls3FDPOClA=="}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:48 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=25 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:22:48 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-16c16e74-4cbb-42d8-b8bf-cc07a021d271 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting quotas for project a82aa8e6724a41e1a4e4d7783876536e. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:22:48 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-16c16e74-4cbb-42d8-b8bf-cc07a021d271 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting quotas for user d7e4e432ab0d448db8c2437e40cbe0cd and project a82aa8e6724a41e1a4e4d7783876536e. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:22:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-16c16e74-4cbb-42d8-b8bf-cc07a021d271 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050987 Apr 14 13:22:48 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 192/581] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:22:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:48 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:48 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:48 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-a13b8bd2-bacd-4058-b997-83e1859060c4 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043946 Apr 14 13:22:48 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 197/582] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:22:48 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:22:49 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1437128410", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "70521388-2232-4fd0-a1b4-41b6901ac702"}], "security_groups": [{"name": "tempest-securitygroup--173918450"}], "key_name": "tempest-keypair-531734162", "user_data": "}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:49 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] validate_networks() for [('70521388-2232-4fd0-a1b4-41b6901ac702', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting quotas for project a82aa8e6724a41e1a4e4d7783876536e. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Getting quotas for user d7e4e432ab0d448db8c2437e40cbe0cd and project a82aa8e6724a41e1a4e4d7783876536e. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:22:50 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:22:50 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b851d111-e38e-4e9e-8c08-2a84ad76db06 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.819990 Apr 14 13:22:50 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 194/583] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:22:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:22:50 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a1c4e92c-13c5-4193-ab05-68c2d0cfc201 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:50 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a1c4e92c-13c5-4193-ab05-68c2d0cfc201 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:50 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-a1c4e92c-13c5-4193-ab05-68c2d0cfc201 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:50 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a1c4e92c-13c5-4193-ab05-68c2d0cfc201 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85" status: 200 len: 1231 microversion: 2.1 time: 0.090473 Apr 14 13:22:50 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 193/584] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:50 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 => generated 1231 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:22:51 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6642d36f-6ab2-436e-a447-902b5b63792e tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '.version_select at 0x7fa743a01ab0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-6642d36f-6ab2-436e-a447-902b5b63792e tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/2bbf35e4-1378-46df-84f2-f839983f7fd6" status: 204 len: 0 microversion: 2.1 time: 0.329477 Apr 14 13:22:52 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 198/585] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:51 2023] DELETE /compute/v2.1/images/2bbf35e4-1378-46df-84f2-f839983f7fd6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:52 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:22:52 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-97e9d0ac-96b0-4253-95ad-87896572c663 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 204 len: 0 microversion: 2.1 time: 0.141863 Apr 14 13:22:52 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 195/586] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:22:52 2023] DELETE /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:22:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:52 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:52 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-unplugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] Creating event network-vif-unplugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:22:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-c7345c82-1a38-405c-9798-83af8fbef9c0 req-e2188568-ffb9-4a2a-8b11-1a03c4820755 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105178 Apr 14 13:22:52 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 199/587] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:53 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '065f23d461f44751a6911adcd3124fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76b733f664b340e289c562e19ebd28c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:22:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-f6003db4-ea96-4502-ba4e-d0c0156ea3fa tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 200 len: 1678 microversion: 2.1 time: 0.807697 Apr 14 13:22:53 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 194/588] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:22:52 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 1678 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:22:54 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-1e566310-9091-4ae4-ab7e-8ac35a43b265 req-4e822c66-9975-4eee-9f96-ecb967b48965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-deleted", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1e566310-9091-4ae4-ab7e-8ac35a43b265 req-4e822c66-9975-4eee-9f96-ecb967b48965 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1e566310-9091-4ae4-ab7e-8ac35a43b265 req-4e822c66-9975-4eee-9f96-ecb967b48965 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1e566310-9091-4ae4-ab7e-8ac35a43b265 req-4e822c66-9975-4eee-9f96-ecb967b48965 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1e566310-9091-4ae4-ab7e-8ac35a43b265 req-4e822c66-9975-4eee-9f96-ecb967b48965 service nova] Creating event network-vif-deleted:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:22:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-1e566310-9091-4ae4-ab7e-8ac35a43b265 req-4e822c66-9975-4eee-9f96-ecb967b48965 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105913 Apr 14 13:22:54 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 196/589] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:54 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65e98ad1-3573-4dce-b9de-bbb1c36ed02e", "name": "network-vif-plugged", "status": "completed", "tag": "965f15ad-1141-41f1-b9f3-41097bb21b5e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] Creating event network-vif-plugged:965f15ad-1141-41f1-b9f3-41097bb21b5e for instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e on user Apr 14 13:22:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-d77a1252-38e0-4e47-9ed8-9b84fdcfc364 req-a8a4c6a7-e886-4793-9478-c8cfde56edd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028105 Apr 14 13:22:54 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 200/590] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:22:56 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c8bc5baf-cb88-4124-826d-232336f0cddf tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.163620 Apr 14 13:22:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 195/591] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:22:56 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-interface => generated 282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed09e4b4-dd5f-4200-be08-7260da0c7d85", "tag": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] Creating event network-changed:0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 on user Apr 14 13:22:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-43f4e41e-01bd-463e-9a31-05c68f299040 req-d681f114-97ff-441c-87e5-78d3fedf9687 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032398 Apr 14 13:22:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 197/592] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:57 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed09e4b4-dd5f-4200-be08-7260da0c7d85", "name": "network-vif-plugged", "status": "completed", "tag": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] Creating event network-vif-plugged:0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 on user Apr 14 13:22:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-9b0a1ed1-1e6f-48f5-a2e1-cfc1628e9f8d req-362f7a01-43c1-4db4-9628-30e15e883e80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030895 Apr 14 13:22:57 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 201/593] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f85a79b-307a-48e6-81fb-01b78bf092dc"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:57 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:22:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7a3d53b8-40f9-44ec-8476-544586f08d13 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278932 Apr 14 13:22:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 196/594] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:22:57 2023] POST /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:58 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] Creating event network-changed:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:22:58 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-13005c1c-b0b9-4514-9efa-f3e63992eb9a req-6d7af626-a4ec-4387-ac8c-3c15fdb715f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029289 Apr 14 13:22:58 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 198/595] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:22:59 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed09e4b4-dd5f-4200-be08-7260da0c7d85", "name": "network-vif-plugged", "status": "completed", "tag": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:22:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:22:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:22:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:22:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] Creating event network-vif-plugged:0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 on user Apr 14 13:22:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-dcf821bc-ad9a-40d0-be35-a74a32d6b92e req-d5c16381-7dad-4168-a5ad-a8153d477429 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036505 Apr 14 13:22:59 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 202/596] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:23:00 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 HTTP/1.1 Apr 14 13:23:00 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:23:00 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:23:00 user devstack@n-api.service[61774]: Connection: close Apr 14 13:23:00 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:23:00 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:23:00 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:23:00 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:23:00 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:23:00 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:23:00 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:23:00 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:23:00 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:23:00 user devstack@n-api.service[61774]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:23:00 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:23:00 user devstack@n-api.service[61774]: method: > Apr 14 13:23:00 user devstack@n-api.service[61774]: exception: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:23:00 user devstack@n-api.service[61774]: action_args: {'id': 'dca3424c-cbca-4520-a495-8867c2a9c0c4'} Apr 14 13:23:00 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:23:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:23:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c963bdb5-d437-4769-a7b4-152d57669b7f tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4" status: 404 len: 111 microversion: 2.1 time: 0.280653 Apr 14 13:23:00 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 197/597] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:00 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:23:00 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:00 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:00 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-8c1a65af-d6da-4f7f-ae18-2ee9a92e1cc4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '.version_select at 0x7fa7439a1fc0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:00 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-8c1a65af-d6da-4f7f-ae18-2ee9a92e1cc4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-858857094" status: 202 len: 0 microversion: 2.1 time: 0.031092 Apr 14 13:23:00 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 199/598] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:23:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-858857094 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:23:01 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-74d161c9-ac0a-4269-aaab-82ca81d4bd4e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: .version_select at 0x7fa743931e10>, body: {"keypair": {"name": "tempest-keypair-1578112597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKg8dU1qqZxvIoy7B9MZfr1N9Qmp8/sb1Cp3tVcrzGMGiIWPn7W4DzC4kWzTVoUug8LQZNSohYWd+IFsh8GZ354HHZ2I1rxyDiEJR3c48LmMMe9YviOl0aUKv762EOVERg=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:01 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-74d161c9-ac0a-4269-aaab-82ca81d4bd4e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:23:01 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-74d161c9-ac0a-4269-aaab-82ca81d4bd4e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for user 65812c6559684eddbdde33cd64ca1fba and project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:23:01 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-74d161c9-ac0a-4269-aaab-82ca81d4bd4e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044826 Apr 14 13:23:01 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 203/599] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:23:01 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:23:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-726689788", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2e129bf7-45b2-41b1-ba6f-5f7359c721bd"}], "security_groups": [{"name": "tempest-securitygroup--1362076546"}], "key_name": "tempest-keypair-1578112597", "user_data": "}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:03 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] validate_networks() for [('2e129bf7-45b2-41b1-ba6f-5f7359c721bd', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Getting quotas for user 65812c6559684eddbdde33cd64ca1fba and project 6833a69217034c4d85ff10bf8aa2fa5c. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:23:04 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:23:04 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a0f48429-51e0-46d4-bb0d-adb7ccd156bd tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.699954 Apr 14 13:23:04 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 198/600] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:23:03 2023] POST /compute/v2.1/servers => generated 400 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:23:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-fd18cbb6-12e2-4ef7-b26b-66abd0c9888b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:04 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-fd18cbb6-12e2-4ef7-b26b-66abd0c9888b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:04 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-fd18cbb6-12e2-4ef7-b26b-66abd0c9888b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:04 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-fd18cbb6-12e2-4ef7-b26b-66abd0c9888b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468" status: 200 len: 1235 microversion: 2.1 time: 0.067995 Apr 14 13:23:04 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 200/601] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:04 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 => generated 1235 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:05 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'flavor' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:23:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e991e108-5744-41c0-ad66-b6a9ecdb7173 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/action" status: 200 len: 32 microversion: 2.1 time: 0.159206 Apr 14 13:23:05 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 204/602] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:23:05 2023] POST /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:23:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:05 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:05 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:06 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-cc6b393e-0385-4a10-bef7-3a8b5d75d326 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 200 len: 1378 microversion: 2.1 time: 0.282540 Apr 14 13:23:06 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 201/603] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:05 2023] GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 1378 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:06 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c9eccb01-7e30-47ed-8072-3e2d92e8bbaa tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 200 len: 1722 microversion: 2.1 time: 0.520439 Apr 14 13:23:06 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 199/604] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:05 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-43db9620-4c4e-4fdc-8d56-fffc113da9ce tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 200 len: 1378 microversion: 2.1 time: 0.370753 Apr 14 13:23:06 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 205/605] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:06 2023] GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 1378 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:23:06 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e58fa5b2-958e-48f6-ac20-ac5ae57fc0f5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 204 len: 0 microversion: 2.1 time: 0.105611 Apr 14 13:23:06 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 200/606] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:23:06 2023] DELETE /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:06 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:06 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b8ef103b-d32b-4bc5-bcfa-dc2b20e1ab12 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1722 microversion: 2.1 time: 0.414598 Apr 14 13:23:06 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 202/607] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:06 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:06 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f18b8c1e-ef0b-4e31-a7cf-f33ca1f9f427 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 200 len: 1384 microversion: 2.1 time: 0.237774 Apr 14 13:23:06 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 206/608] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:06 2023] GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 1384 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:06 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:07 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21aa2e30-d383-4f3b-8c40-7a06968ecb8c", "name": "network-vif-unplugged", "status": "completed", "tag": "4ded420e-025f-481e-85a1-010b7e3d71f7"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] Creating event network-vif-unplugged:4ded420e-025f-481e-85a1-010b7e3d71f7 for instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c on user Apr 14 13:23:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-2d928312-81f0-4ecb-9f08-e19a900da0c8 req-b46e0ff7-3c0a-49c3-9356-84171c89e933 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041688 Apr 14 13:23:07 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 203/609] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:23:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:23:07 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-dabbcde4-a2de-472a-a601-37578764c3ee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1722 microversion: 2.1 time: 0.470237 Apr 14 13:23:07 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 201/610] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:06 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:08 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:09 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:09 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-8e6da8b4-6de2-47f4-8b50-028387193e87 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1536 microversion: 2.1 time: 0.259098 Apr 14 13:23:09 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 207/611] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:08 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1536 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21aa2e30-d383-4f3b-8c40-7a06968ecb8c", "name": "network-vif-plugged", "status": "completed", "tag": "4ded420e-025f-481e-85a1-010b7e3d71f7"}, {"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-unplugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}, {"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}, {"server_uuid": "21aa2e30-d383-4f3b-8c40-7a06968ecb8c", "name": "network-vif-plugged", "status": "completed", "tag": "4ded420e-025f-481e-85a1-010b7e3d71f7"}, {"name": "network-changed", "server_uuid": "01f10bee-45ba-4541-8af8-e392018ef468", "tag": "45024c25-a182-4df9-bec0-ab8dc8354659"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Creating event network-vif-plugged:4ded420e-025f-481e-85a1-010b7e3d71f7 for instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c on user Apr 14 13:23:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Creating event network-vif-unplugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:23:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:23:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Creating event network-vif-plugged:4ded420e-025f-481e-85a1-010b7e3d71f7 for instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c on user Apr 14 13:23:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] Creating event network-changed:45024c25-a182-4df9-bec0-ab8dc8354659 for instance 01f10bee-45ba-4541-8af8-e392018ef468 on user Apr 14 13:23:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-52c6c137-a5b4-4280-9e46-aaee7d1bd40a req-5bacac53-7b1e-4d75-b20d-6ec2ebfd2685 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 865 microversion: 2.1 time: 0.058006 Apr 14 13:23:09 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 204/612] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:23:09 2023] POST /compute/v2.1/os-server-external-events => generated 865 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:23:11 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21aa2e30-d383-4f3b-8c40-7a06968ecb8c", "name": "network-vif-deleted", "tag": "4ded420e-025f-481e-85a1-010b7e3d71f7"}, {"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}, {"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Creating event network-vif-deleted:4ded420e-025f-481e-85a1-010b7e3d71f7 for instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c on user Apr 14 13:23:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:23:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:23:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-34d6779e-ce19-4dd3-89f7-6821dbf94ada req-404c5c1b-c566-4274-948c-6ab74aac19aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038415 Apr 14 13:23:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 202/613] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:23:11 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:23:13 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f10bee-45ba-4541-8af8-e392018ef468", "name": "network-vif-plugged", "status": "completed", "tag": "45024c25-a182-4df9-bec0-ab8dc8354659"}, {"server_uuid": "01f10bee-45ba-4541-8af8-e392018ef468", "name": "network-vif-plugged", "status": "completed", "tag": "45024c25-a182-4df9-bec0-ab8dc8354659"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:13 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:13 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Creating event network-vif-plugged:45024c25-a182-4df9-bec0-ab8dc8354659 for instance 01f10bee-45ba-4541-8af8-e392018ef468 on user Apr 14 13:23:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] Creating event network-vif-plugged:45024c25-a182-4df9-bec0-ab8dc8354659 for instance 01f10bee-45ba-4541-8af8-e392018ef468 on user Apr 14 13:23:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-9a1cdd11-3c1f-40ed-a399-09f2d7c71e97 req-bebc335f-6c66-4ea8-aa1a-7adc11b78366 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039397 Apr 14 13:23:13 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 208/614] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:23:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:23:17 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:17 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:17 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:17 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:18 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-f467a266-a7af-4688-b42e-c2f54d9d90f5 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 200 len: 1494 microversion: 2.1 time: 0.285371 Apr 14 13:23:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 205/615] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:17 2023] GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 1494 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:23 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-473e13c1-a24c-426d-be5b-0bd6068d3b2a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments/1fe1d12d-36df-40a9-a5dd-ce6280d95839" status: 200 len: 194 microversion: 2.20 time: 0.144148 Apr 14 13:23:23 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 203/616] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 13:23:23 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments/1fe1d12d-36df-40a9-a5dd-ce6280d95839 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:24 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'services' on Instance uuid 1a866f3f-b709-4286-8cef-8e3b35f26d0b {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:23:24 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-dc004f90-9519-4957-93aa-0923de5121fb tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments/1fe1d12d-36df-40a9-a5dd-ce6280d95839" status: 202 len: 0 microversion: 2.20 time: 0.165170 Apr 14 13:23:24 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 209/617] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 13:23:24 2023] DELETE /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments/1fe1d12d-36df-40a9-a5dd-ce6280d95839 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:23:24 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:24 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-7dd27e7f-cb8c-4ab6-b948-77380e3e9fb6 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053732 Apr 14 13:23:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 206/618] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 13:23:24 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:23:29 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:29 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-3b2e9789-7a51-44bf-849e-6a4de603356e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095/action" status: 202 len: 0 microversion: 2.87 time: 0.070127 Apr 14 13:23:29 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 204/619] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:23:29 2023] POST /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:29 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e4e95ebe-4eac-49d0-93fb-b17e49f894a2 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 200 len: 1762 microversion: 2.87 time: 0.233006 Apr 14 13:23:29 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 210/620] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:23:29 2023] GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 1762 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:23:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-unplugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] Creating event network-vif-unplugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:23:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-e56a5014-44f9-4a11-a658-917f17d6d02d req-5234bcf1-9290-4036-ab3a-6a06fbc6c013 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125715 Apr 14 13:23:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 207/621] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:23:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:23:32 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}, {"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:32 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:23:32 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:23:32 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-1c4cc0a4-c0f4-4434-bf2f-0991a6abbfbd req-95ad636e-f988-4080-8ce6-d4a9428293b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033185 Apr 14 13:23:32 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 205/622] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:23:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:23:34 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:23:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:34 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:23:34 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-7b8f1c53-da90-433f-8cf8-ac71c7900016 req-c2924b50-0d9f-4e4f-87fb-6103e3f7a32d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050538 Apr 14 13:23:34 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 211/623] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=5 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=13 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:41 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-825d3901-c2c0-455b-a9a7-6ee7b1f9dcd3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85" status: 200 len: 1536 microversion: 2.1 time: 0.287670 Apr 14 13:23:41 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 208/624] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:40 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 => generated 1536 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] [instance: 65e98ad1-3573-4dce-b9de-bbb1c36ed02e] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] HTTP exception thrown: Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e could not be found. Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Request method failure captured: Apr 14 13:23:43 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e HTTP/1.1 Apr 14 13:23:43 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:23:43 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:23:43 user devstack@n-api.service[61774]: Connection: close Apr 14 13:23:43 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:23:43 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:23:43 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:23:43 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:23:43 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVH25W9QDDZR7WMf8micA02wC_64KkgvI3wyqU3ZAmiG64rHT9CWbsYhpp98eSgUrcvwQ3iZj8UUUX4vodp_PPx9HJObYUj6VExDv9xDgF3owt2gDfOFyZVchDPTrKkvPeV6NQM5XzbemGswXITCRWcvTnc5XqP0FkaFM6VgbaFYGh8 Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Project-Id: 76b733f664b340e289c562e19ebd28c3 Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Project-Name: tempest-ServerStableDeviceRescueTest-583958040 Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76b733f664b340e289c562e19ebd28c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76b733f664b340e289c562e19ebd28c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76b733f664b340e289c562e19ebd28c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Tenant: tempest-ServerStableDeviceRescueTest-583958040 Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Tenant-Id: 76b733f664b340e289c562e19ebd28c3 Apr 14 13:23:43 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-583958040 Apr 14 13:23:43 user devstack@n-api.service[61774]: X-User: tempest-ServerStableDeviceRescueTest-583958040-project-member Apr 14 13:23:43 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:23:43 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:23:43 user devstack@n-api.service[61774]: X-User-Id: 065f23d461f44751a6911adcd3124fe9 Apr 14 13:23:43 user devstack@n-api.service[61774]: X-User-Name: tempest-ServerStableDeviceRescueTest-583958040-project-member Apr 14 13:23:43 user devstack@n-api.service[61774]: method: > Apr 14 13:23:43 user devstack@n-api.service[61774]: exception: Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e could not be found. Apr 14 13:23:43 user devstack@n-api.service[61774]: action_args: {'id': '65e98ad1-3573-4dce-b9de-bbb1c36ed02e'} Apr 14 13:23:43 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e could not be found. Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e could not be found. Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e could not be found. Apr 14 13:23:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Returning 404 to user: Instance 65e98ad1-3573-4dce-b9de-bbb1c36ed02e could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:23:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-96ff1fa9-a401-4a96-8fee-b3b1fdcca31c tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e" status: 404 len: 111 microversion: 2.1 time: 0.032120 Apr 14 13:23:43 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 206/625] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:43 2023] GET /compute/v2.1/servers/65e98ad1-3573-4dce-b9de-bbb1c36ed02e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:23:43 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2f5c94b0-2fa7-4201-8454-20bb68ef2d72 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] Calling method '.version_select at 0x7fa74381e050>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:43 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2f5c94b0-2fa7-4201-8454-20bb68ef2d72 tempest-ServerStableDeviceRescueTest-583958040 tempest-ServerStableDeviceRescueTest-583958040-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253237269" status: 202 len: 0 microversion: 2.1 time: 0.021987 Apr 14 13:23:43 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 212/626] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 13:23:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253237269 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:54 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-23ebbec1-7933-4a87-9134-f3f195706961 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468" status: 200 len: 1545 microversion: 2.1 time: 0.263773 Apr 14 13:23:54 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 209/627] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:54 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 => generated 1545 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:56 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:23:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-236b2975-190a-45ef-bcad-bc419202d5b8 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 200 len: 1702 microversion: 2.1 time: 0.485832 Apr 14 13:23:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 207/628] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:56 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 1702 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:23:56 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c HTTP/1.1 Apr 14 13:23:56 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:23:56 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:23:56 user devstack@n-api.service[61776]: Connection: close Apr 14 13:23:56 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:23:56 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:23:56 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:23:56 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:23:56 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:23:56 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:56 user devstack@n-api.service[61776]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:23:56 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:23:56 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:23:56 user devstack@n-api.service[61776]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:23:56 user devstack@n-api.service[61776]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:23:56 user devstack@n-api.service[61776]: method: > Apr 14 13:23:56 user devstack@n-api.service[61776]: exception: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:56 user devstack@n-api.service[61776]: action_args: {'id': '21aa2e30-d383-4f3b-8c40-7a06968ecb8c'} Apr 14 13:23:56 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:23:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:23:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-1ac75f20-4c4b-4a9c-bf4e-f3bb4141bf94 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 404 len: 111 microversion: 2.1 time: 0.038130 Apr 14 13:23:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 213/629] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:56 2023] GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:23:57 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c HTTP/1.1 Apr 14 13:23:57 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:23:57 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:23:57 user devstack@n-api.service[61775]: Connection: close Apr 14 13:23:57 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:23:57 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:23:57 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:23:57 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:23:57 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:23:57 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:57 user devstack@n-api.service[61775]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:23:57 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:23:57 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:23:57 user devstack@n-api.service[61775]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:23:57 user devstack@n-api.service[61775]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:23:57 user devstack@n-api.service[61775]: method: > Apr 14 13:23:57 user devstack@n-api.service[61775]: exception: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61775]: action_args: {'id': '21aa2e30-d383-4f3b-8c40-7a06968ecb8c'} Apr 14 13:23:57 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:23:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-62937fdf-7927-4b4e-8238-0cf8c2d0afd8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 404 len: 111 microversion: 2.1 time: 0.031258 Apr 14 13:23:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 210/630] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:23:57 2023] DELETE /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 21aa2e30-d383-4f3b-8c40-7a06968ecb8c] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:23:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:23:57 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c HTTP/1.1 Apr 14 13:23:57 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:23:57 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:23:57 user devstack@n-api.service[61774]: Connection: close Apr 14 13:23:57 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:23:57 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:23:57 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:23:57 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:23:57 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:23:57 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:23:57 user devstack@n-api.service[61774]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:23:57 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:23:57 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:23:57 user devstack@n-api.service[61774]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:23:57 user devstack@n-api.service[61774]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:23:57 user devstack@n-api.service[61774]: method: > Apr 14 13:23:57 user devstack@n-api.service[61774]: exception: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61774]: action_args: {'id': '21aa2e30-d383-4f3b-8c40-7a06968ecb8c'} Apr 14 13:23:57 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. Apr 14 13:23:57 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:23:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 21aa2e30-d383-4f3b-8c40-7a06968ecb8c could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:23:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7132e7ff-88da-447e-b267-e9abb3643e64 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c" status: 404 len: 111 microversion: 2.1 time: 0.029492 Apr 14 13:23:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 208/631] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:23:57 2023] GET /compute/v2.1/servers/21aa2e30-d383-4f3b-8c40-7a06968ecb8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:07 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lazy-loading 'services' on Instance uuid 6e646c88-579e-4ea1-b987-da1c7194a064 {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:24:07 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1066264697", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "fa06c410-d2f3-4211-98a9-d8bae7d21b29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "32e04661-5709-44d8-b16f-bc45b62317fc"}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:07 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:07 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=8 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:07 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-546353be-ee2a-439b-b1f7-d89379893d84 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments/0dc33843-6235-4794-844e-9fc4db46c60e" status: 202 len: 0 microversion: 2.1 time: 0.168555 Apr 14 13:24:07 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 214/632] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:24:07 2023] DELETE /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments/0dc33843-6235-4794-844e-9fc4db46c60e => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:24:07 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] validate_networks() for [('32e04661-5709-44d8-b16f-bc45b62317fc', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=10 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-792adac6-4b9e-41fe-b161-20cb7d655d02 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054370 Apr 14 13:24:07 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 209/633] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:24:07 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for user bb40413bd0c3490d97b997f69c930f72 and project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:24:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa06c410-d2f3-4211-98a9-d8bae7d21b29',volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:24:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b75bebad-07c4-4f0b-839d-3aacc1361470 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.905327 Apr 14 13:24:08 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 211/634] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:24:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:24:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-70a7d46f-6c2e-4c9f-98aa-41eb31c6d243 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:08 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-70a7d46f-6c2e-4c9f-98aa-41eb31c6d243 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:08 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-70a7d46f-6c2e-4c9f-98aa-41eb31c6d243 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-70a7d46f-6c2e-4c9f-98aa-41eb31c6d243 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3" status: 200 len: 1066 microversion: 2.1 time: 0.078167 Apr 14 13:24:08 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 215/635] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:08 2023] GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 => generated 1066 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:09 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:09 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b1394083-5d4a-4650-b121-1d3503a959fc tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1536 microversion: 2.1 time: 0.245844 Apr 14 13:24:09 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 210/636] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:09 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1536 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Searching by: {'deleted': False, 'project_id': '9ae2e95243bc4e19b093629197fbb173'} {{(pid=61775) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:09 user devstack@n-api.service[61775]: DEBUG nova.compute.multi_cell_list [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61775) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 13:24:09 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3d5146e1-6127-4696-8bba-697eb0043e6c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.179184 Apr 14 13:24:09 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 212/637] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 13:24:09 2023] GET /compute/v2.1/servers => generated 340 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:09 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:09 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-aa3bbfa3-922a-4ebf-9622-0fb155ed0240 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1536 microversion: 2.1 time: 0.290394 Apr 14 13:24:09 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 216/638] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:09 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1536 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:11 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82d3b319-f069-48b6-bb53-32835bc6a2e3", "tag": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] Creating event network-changed:6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 on user Apr 14 13:24:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-c7b96525-3a2c-4e98-8936-f22c897b205f req-7e8432a2-341e-4f83-aa0a-498d0abc9ba4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028882 Apr 14 13:24:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 211/639] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:12 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcdfe359-4681-4ebf-847d-85edfd26edc0"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:12 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:12 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d450e33d-d56c-460c-9eab-622692c7e281 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342133 Apr 14 13:24:12 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 213/640] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:24:12 2023] POST /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-b1f936f6-9220-4d0e-9a7a-c9944ad2f3f5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044979 Apr 14 13:24:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 217/641] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 13:24:14 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:24:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1cb7dc03-aff2-4a06-aecc-73484b2adcb2 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 204 len: 0 microversion: 2.20 time: 0.120641 Apr 14 13:24:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 212/642] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:24:14 2023] DELETE /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:14 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-76e66c32-07f3-4d69-80b5-3293edcf872a tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 200 len: 1712 microversion: 2.20 time: 0.423780 Apr 14 13:24:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 214/643] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:24:14 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 1712 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-unplugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] Creating event network-vif-unplugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:24:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-421b0021-2ec1-48fc-9594-33c7f585f5ad req-79d15000-5fa3-4e45-a08b-c00d3c03e754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032727 Apr 14 13:24:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 218/644] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-deleted", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:16 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] Creating event network-vif-deleted:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:24:16 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-8396df35-f292-440d-bf0e-103b36a8dfe2 req-a3519f73-54e2-44c8-a537-452d500bba27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 Apr 14 13:24:16 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 213/645] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:24:17 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}, {"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}, {"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}, {"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-unplugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}, {"server_uuid": "1a866f3f-b709-4286-8cef-8e3b35f26d0b", "name": "network-vif-plugged", "status": "completed", "tag": "351008cc-2fb2-4fa8-997d-96ea40263d9d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:24:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:24:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:24:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Creating event network-vif-unplugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:24:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] Creating event network-vif-plugged:351008cc-2fb2-4fa8-997d-96ea40263d9d for instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b on user Apr 14 13:24:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-54f8c622-68a6-4cd6-87f4-03363a14f46e req-13649b00-0511-464b-aade-3da3952deee2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.038189 Apr 14 13:24:17 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 215/646] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:16 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:17 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d3b319-f069-48b6-bb53-32835bc6a2e3", "name": "network-vif-plugged", "status": "completed", "tag": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] Creating event network-vif-plugged:6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 on user Apr 14 13:24:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-7c2cf4e5-f9dd-4110-943c-598afe3f5e8c req-2b13fc43-7abd-407b-9b0f-981cea19c5a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047251 Apr 14 13:24:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 219/647] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:19 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:19 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-2dd38b12-03a9-4b25-8de3-94f55eb380ca tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 200 len: 1768 microversion: 2.87 time: 0.297739 Apr 14 13:24:19 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 214/648] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:24:19 2023] GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 1768 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:24:20 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d3b319-f069-48b6-bb53-32835bc6a2e3", "name": "network-vif-plugged", "status": "completed", "tag": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:20 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:20 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] Creating event network-vif-plugged:6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 on user Apr 14 13:24:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-870ca6a8-184f-4a19-8583-6c1b68dd437e req-8b5d11de-0b14-4c52-9c24-c7d1b2cc7d76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036240 Apr 14 13:24:20 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 216/649] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:20 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4e3a51a6-d2e8-40ed-a55a-eb41738ee670 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1573144709", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "destination_type": "local"}, {"source_type": "volume", "uuid": "c7f29224-f09e-43ef-9dfc-b1bd76e3b2da", "destination_type": "invalid"}], "networks": [{"uuid": "73061151-2d01-43ae-9ac6-841d71c038ba"}]}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4e3a51a6-d2e8-40ed-a55a-eb41738ee670 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Request method failure captured: Apr 14 13:24:20 user devstack@n-api.service[61776]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 13:24:20 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:24:20 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:24:20 user devstack@n-api.service[61776]: Connection: close Apr 14 13:24:20 user devstack@n-api.service[61776]: Content-Length: 494 Apr 14 13:24:20 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:24:20 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:24:20 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:24:20 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVI3LyLT14ImRPIYeF6YAL3zUPp4aHdeRySuqatLcEpMh_Bcu61fTZDhqM3bjsg5-R5SaHgBHmQHjC-Xe8ZmGQ-dgPb8URDyOpCCHN4uhdgFYgCCC1jX1KH2yXZXpwHcqH1ITNDlTGk2hVOhLxkLt4q9tSMqGtjE-mav9O1H82Hlft4 Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Project-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Project-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Tenant: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Tenant-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:24:20 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:24:20 user devstack@n-api.service[61776]: X-User: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:24:20 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:24:20 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:24:20 user devstack@n-api.service[61776]: X-User-Id: 3f713f95191542f6a23ee25669061b27 Apr 14 13:24:20 user devstack@n-api.service[61776]: X-User-Name: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:24:20 user devstack@n-api.service[61776]: Apr 14 13:24:20 user devstack@n-api.service[61776]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1573144709", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "destination_type": "local"}, {"source_type": "volume", "uuid": "c7f29224-f09e-43ef-9dfc-b1bd76e3b2da", "destination_type": "invalid"}], "networks": [{"uuid": "73061151-2d01-43ae-9ac6-841d71c038ba"}]}} Apr 14 13:24:20 user devstack@n-api.service[61776]: method: > Apr 14 13:24:20 user devstack@n-api.service[61776]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 13:24:20 user devstack@n-api.service[61776]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1573144709', 'imageRef': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '364f8f0e-9be3-4fd9-80d8-be290e16b4b1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c7f29224-f09e-43ef-9dfc-b1bd76e3b2da', 'destination_type': 'invalid'}], 'networks': [{'uuid': '73061151-2d01-43ae-9ac6-841d71c038ba'}]}}} Apr 14 13:24:20 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise error Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 13:24:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:24:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4e3a51a6-d2e8-40ed-a55a-eb41738ee670 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:24:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4e3a51a6-d2e8-40ed-a55a-eb41738ee670 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012982 Apr 14 13:24:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 220/650] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:24:20 2023] POST /compute/v2.1/servers => generated 155 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:24:20 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:20 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:21 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:21 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ee849203-1b45-4f27-9e0a-a1cf1158a9fb tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 200 len: 1494 microversion: 2.1 time: 0.303111 Apr 14 13:24:21 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 215/651] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:20 2023] GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 1494 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:23 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:24 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-17130e47-6210-4f38-be2a-952edabcb0c9 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1582 microversion: 2.1 time: 0.239058 Apr 14 13:24:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 217/652] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:23 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1582 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:26 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49467859-954f-498d-b520-587c7f38effc", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] Creating event network-changed:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f6995af7-43d0-4b27-9257-7e48a62af4e1 req-73e8da4b-c76e-4d99-9513-fe17d28d66a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044165 Apr 14 13:24:26 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 221/653] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:28 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1705894697"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:28 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:28 user devstack@n-api.service[61774]: INFO nova.network.security_group_api [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Adding security group a7c19468-44d9-4a4d-94d3-784976b649ad to port bcff28e3-32d8-4f26-b087-4b1082f06cfb Apr 14 13:24:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-8c84f4a2-6eaf-4483-990e-0d4de1e36c57 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/action" status: 202 len: 0 microversion: 2.1 time: 0.816869 Apr 14 13:24:28 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 216/654] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:24:28 2023] POST /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:24:28 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:28 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49467859-954f-498d-b520-587c7f38effc", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] Creating event network-changed:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f4d674bb-669a-475e-8a92-4f91119b5c7d req-ed0dd460-23a6-46bd-8791-1c1fcdd3a38e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033992 Apr 14 13:24:29 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 222/655] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:24:29 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:29 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-603427b4-b475-4ef2-a031-6af7c0fa35a1 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1747 microversion: 2.1 time: 0.315216 Apr 14 13:24:29 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 218/656] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:28 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1747 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:32 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:32 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:32 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9172b6ad-077d-4775-9444-2dd419db8c5e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/action" status: 202 len: 0 microversion: 2.1 time: 0.099349 Apr 14 13:24:32 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 217/657] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:24:32 2023] POST /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:24:32 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:32 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:33 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:33 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-550a0600-03f4-4ec3-8e67-9151e51b1410 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1749 microversion: 2.1 time: 0.254445 Apr 14 13:24:33 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 223/658] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:32 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1749 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:33 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-unplugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] Creating event network-vif-unplugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-f93d53ee-ea67-4c82-bd38-3e6554430eae req-1dce27f0-cb8a-4202-9572-dbad26fbbca8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051987 Apr 14 13:24:33 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 219/659] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:35 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}, {"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}, {"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}, {"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-unplugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}, {"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:36 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Creating event network-vif-unplugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:36 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-127571e6-8760-4150-adbe-79a2144755f2 req-db1a2f17-d72a-4153-942e-f4d72cb4880f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.040726 Apr 14 13:24:36 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 218/660] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:39 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:39 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=21 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:39 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-b5f94e36-03c0-4373-a702-e468949078a4 req-86172db2-3909-4d1e-bc22-28c47cdf22be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049530 Apr 14 13:24:39 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 224/661] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:41 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:41 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:41 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:24:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-63b3843d-ed80-4b0f-b73e-8396b33521c8 req-75dd715b-5109-49af-abb2-39a89d270027 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Apr 14 13:24:41 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 220/662] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:41 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9de47a44-5847-4cbe-a206-fe950edc6958 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.166632 Apr 14 13:24:41 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 219/663] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:24:41 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-interface => generated 282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:42 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:42 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:42 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-0c55b36d-9f8b-4559-805f-675a0e0872d3 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/ips" status: 200 len: 104 microversion: 2.1 time: 0.137839 Apr 14 13:24:42 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 225/664] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:24:42 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/ips => generated 104 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed09e4b4-dd5f-4200-be08-7260da0c7d85", "tag": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] Creating event network-changed:0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 on user Apr 14 13:24:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-1792110f-a659-4bd9-913d-6fd89d122b26 req-c2751eb3-5795-4c48-99d1-6e2a0938745e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048701 Apr 14 13:24:43 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 221/665] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:45 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31003792-6da3-45f1-9abb-32d6dd53dc98"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:45 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:45 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-59d48db1-91cb-4440-b4f6-24990a33b401 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267247 Apr 14 13:24:45 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 220/666] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:24:45 2023] POST /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=3 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=5 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e6acf17f-5e2e-4cd7-afbf-8f70dbadedb5 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056823 Apr 14 13:24:53 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 226/667] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:24:53 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-2f89d694-1423-4412-b6a9-3308a566194d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/31003792-6da3-45f1-9abb-32d6dd53dc98" status: 200 len: 194 microversion: 2.1 time: 0.044204 Apr 14 13:24:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 222/668] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 13:24:53 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/31003792-6da3-45f1-9abb-32d6dd53dc98 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:54 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:54 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-582d4999-eab6-48e2-b44c-2a8a2a67f9f0 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.161307 Apr 14 13:24:55 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 221/669] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:24:54 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-interface => generated 283 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:55 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a20ffa11-b01c-45cc-8a71-f534c44f8568"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:55 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f10bee-45ba-4541-8af8-e392018ef468", "tag": "45024c25-a182-4df9-bec0-ab8dc8354659"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] Creating event network-changed:45024c25-a182-4df9-bec0-ab8dc8354659 for instance 01f10bee-45ba-4541-8af8-e392018ef468 on user Apr 14 13:24:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-71cf4a7f-5491-4f19-bb18-045bfd33292a req-738ad0fa-e311-4ef1-808f-9fed2cfc6965 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029531 Apr 14 13:24:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 223/670] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:56 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-8bc02a2a-a492-44af-913a-85c392429739 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/ips" status: 200 len: 108 microversion: 2.1 time: 0.035547 Apr 14 13:24:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 222/671] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:24:56 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d3f1d4fd-61ce-4c76-ac8f-d78dd252752b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321069 Apr 14 13:24:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 227/672] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:24:55 2023] POST /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 775293fc-1773-407d-bf49-fccfe849f440 while it is in vm_state rescued Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Request method failure captured: Apr 14 13:24:57 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments/7f85a79b-307a-48e6-81fb-01b78bf092dc HTTP/1.1 Apr 14 13:24:57 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:24:57 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:24:57 user devstack@n-api.service[61775]: Connection: close Apr 14 13:24:57 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:24:57 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:24:57 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:24:57 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:24:57 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE7CGJtJfygjQPSdMR9HSJ45TI47-gc7b_dYSZu4c6o-461OeFnWunYQdMelQeuQMoyYrT4x_8u-ku0jtC8aSfJi9VllPjdCnuGgerzPdVXG2IqpenQO2JJJpbhVia5ePLnIh7jnyHBoauudGF2BYrj_V1DNjXJ6YywwM3H7Bd_qAA Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Project-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Tenant-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:24:57 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:24:57 user devstack@n-api.service[61775]: X-User: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:24:57 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:24:57 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:24:57 user devstack@n-api.service[61775]: X-User-Id: 3948b7c643374bcdbeb34f0f2f790c3c Apr 14 13:24:57 user devstack@n-api.service[61775]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:24:57 user devstack@n-api.service[61775]: method: > Apr 14 13:24:57 user devstack@n-api.service[61775]: exception: Cannot 'detach_volume' instance 775293fc-1773-407d-bf49-fccfe849f440 while it is in vm_state rescued Apr 14 13:24:57 user devstack@n-api.service[61775]: action_args: {'server_id': '775293fc-1773-407d-bf49-fccfe849f440', 'id': '7f85a79b-307a-48e6-81fb-01b78bf092dc'} Apr 14 13:24:57 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 775293fc-1773-407d-bf49-fccfe849f440 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 775293fc-1773-407d-bf49-fccfe849f440 while it is in vm_state rescued Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 775293fc-1773-407d-bf49-fccfe849f440 while it is in vm_state rescued Apr 14 13:24:57 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Returning 409 to user: Cannot 'detach_volume' instance 775293fc-1773-407d-bf49-fccfe849f440 while it is in vm_state rescued {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:24:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-cb590570-11fe-491c-9a91-0619d207c827 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments/7f85a79b-307a-48e6-81fb-01b78bf092dc" status: 409 len: 152 microversion: 2.1 time: 0.135858 Apr 14 13:24:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 224/673] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:24:57 2023] DELETE /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments/7f85a79b-307a-48e6-81fb-01b78bf092dc => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1ff6ebce-bec9-4a22-805d-acb3d7955432 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "POST /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/action" status: 202 len: 0 microversion: 2.1 time: 0.083005 Apr 14 13:24:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 223/674] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:24:57 2023] POST /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-36082f33-42ca-4b1b-9cf2-f60149e52d01 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 200 len: 1710 microversion: 2.1 time: 0.263816 Apr 14 13:24:57 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 228/675] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:57 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 1710 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-752b78f1-c55a-4878-92d8-ad97f57ea1d3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041528 Apr 14 13:24:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 225/676] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:24:57 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f89394ef-17be-4375-8971-c9fa45166bee"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-34d0a9f6-68a5-4b87-a345-8698c5fe0f8b tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1676 microversion: 2.1 time: 0.809741 Apr 14 13:24:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 224/677] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:57 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1676 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-06e7ceaa-ceab-4330-8748-02cfe458d987 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3" status: 200 len: 1393 microversion: 2.1 time: 0.246427 Apr 14 13:24:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 229/678] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:58 2023] GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-unplugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] Creating event network-vif-unplugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:24:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-1ad41a9b-9a88-4299-96fe-f34452f24e03 req-3e2075d9-904b-4ac9-a91b-2b10f737085d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030505 Apr 14 13:24:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 230/679] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:24:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:58 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c4f9a22d-585e-42ba-bac4-847750d401a5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1676 microversion: 2.1 time: 0.227605 Apr 14 13:24:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 225/680] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:58 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:24:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:24:59 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e3078fe6-b7de-4028-94ce-d6c1cebcde2e tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "POST /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419248 Apr 14 13:24:59 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 226/681] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:24:58 2023] POST /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:24:59 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:24:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9fa7506a-7a8c-4c93-bda2-a54d316ee1c8 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1676 microversion: 2.1 time: 0.229754 Apr 14 13:24:59 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 231/682] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:24:58 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:25:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}, {"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}, {"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:25:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:25:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:25:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-46b9579b-d5d1-47ce-b57e-ef50c48859b9 req-568b4a10-dc30-4430-af90-561090db12df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038186 Apr 14 13:25:00 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 226/683] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:00 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-91097929-c46c-488e-858a-d29f60936a46 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044498 Apr 14 13:25:03 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 227/684] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:25:03 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:03 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-5254e97a-346a-4cfa-8597-b95f308ff667 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/31003792-6da3-45f1-9abb-32d6dd53dc98" status: 200 len: 194 microversion: 2.1 time: 0.047423 Apr 14 13:25:03 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 232/685] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 13:25:03 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/31003792-6da3-45f1-9abb-32d6dd53dc98 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:03 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:04 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'services' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:25:04 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7495fb98-4677-4697-9ca2-464b2586c77a tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/31003792-6da3-45f1-9abb-32d6dd53dc98" status: 202 len: 0 microversion: 2.1 time: 0.206455 Apr 14 13:25:04 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 227/686] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:25:03 2023] DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/31003792-6da3-45f1-9abb-32d6dd53dc98 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:25:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:04 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] HTTP exception thrown: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:25:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Request method failure captured: Apr 14 13:25:05 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b HTTP/1.1 Apr 14 13:25:05 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:25:05 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:25:05 user devstack@n-api.service[61775]: Connection: close Apr 14 13:25:05 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:25:05 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:25:05 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:25:05 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:25:05 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVJ0L00ckejtJxU6XxKcFnn6_fUq6MVy8jUhoW5zU-iCCo5FfT7SVU1imrpzzLyLqVWhKrdZL2FUUV0wSSXiXfypWSHk8TAApNW7f0JUebvLMSuDHVG4auQs3vsgbBNDjz2C4AuNKDVoIxbeRA4BtsERYW4_CPmZUYS_MZeKXxFHvfw Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Project-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Tenant-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:25:05 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:25:05 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:25:05 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:25:05 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:25:05 user devstack@n-api.service[61775]: X-User-Id: f04370605aec40a0a53a080c1e8bf8a8 Apr 14 13:25:05 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:25:05 user devstack@n-api.service[61775]: method: > Apr 14 13:25:05 user devstack@n-api.service[61775]: exception: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:25:05 user devstack@n-api.service[61775]: action_args: {'id': '1a866f3f-b709-4286-8cef-8e3b35f26d0b'} Apr 14 13:25:05 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:25:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Returning 404 to user: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:25:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-25c8464b-93f5-4213-8af9-b1b5a7c56853 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 404 len: 111 microversion: 2.20 time: 0.031351 Apr 14 13:25:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 228/687] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:25:04 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:25:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-937bbee2-170a-40bf-a8f8-0d1b00e9fbc5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '.version_select at 0x7fa743a6e5f0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-937bbee2-170a-40bf-a8f8-0d1b00e9fbc5 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859762998" status: 204 len: 0 microversion: 2.20 time: 0.021770 Apr 14 13:25:05 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 233/688] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 13:25:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859762998 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:25:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ee06abd3-b0eb-4ab5-b56f-d01d39b3f4ae tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'create', calling method: .version_select at 0x7fa743873be0>, body: {"keypair": {"name": "tempest-keypair-321023180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM58epGqhtKxGXJ/+xFhEOxUulN613XjttUVnaW18pLMGQ2SIMhHBKaAkyjthPjHjJkakSAYkqQ670pGkRR5B7mIl8EE7DrTXrHs+Sy5Z42MrNXXIqNpGIAl9c8To2l2Sg=="}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:05 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-ee06abd3-b0eb-4ab5-b56f-d01d39b3f4ae tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting quotas for project 8f0fee50983a4e31b1689dc77b1c4db1. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:25:05 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-ee06abd3-b0eb-4ab5-b56f-d01d39b3f4ae tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting quotas for user f04370605aec40a0a53a080c1e8bf8a8 and project 8f0fee50983a4e31b1689dc77b1c4db1. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:25:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ee06abd3-b0eb-4ab5-b56f-d01d39b3f4ae tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.059489 Apr 14 13:25:05 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 228/689] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 13:25:05 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 13:25:06 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:06 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:07 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lazy-loading 'services' on Instance uuid 01f10bee-45ba-4541-8af8-e392018ef468 {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:25:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-02299188-9e69-4f6b-b753-712a5ac2a970 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-volume_attachments/f89394ef-17be-4375-8971-c9fa45166bee" status: 202 len: 0 microversion: 2.1 time: 0.222100 Apr 14 13:25:07 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 229/690] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:25:06 2023] DELETE /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-volume_attachments/f89394ef-17be-4375-8971-c9fa45166bee => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:07 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-70eed7a3-dfcc-492e-beb9-02b3d7fabc5b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043379 Apr 14 13:25:07 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 234/691] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:25:07 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:07 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:07 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:07 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1289054872", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ce72cb91-222b-4491-af4a-bd9a67637d69"}], "security_groups": [{"name": "tempest-securitygroup--1826650927"}], "key_name": "tempest-keypair-321023180", "user_data": "}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-997cfe81-6265-4810-9b26-39c15567f1b4 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/a20ffa11-b01c-45cc-8a71-f534c44f8568" status: 200 len: 194 microversion: 2.1 time: 0.080493 Apr 14 13:25:07 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 229/692] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 13:25:07 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/a20ffa11-b01c-45cc-8a71-f534c44f8568 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:07 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] validate_networks() for [('ce72cb91-222b-4491-af4a-bd9a67637d69', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:25:07 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lazy-loading 'services' on Instance uuid ed09e4b4-dd5f-4200-be08-7260da0c7d85 {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:25:07 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-b1d90007-104d-4a66-a72f-5e885a180abb tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/a20ffa11-b01c-45cc-8a71-f534c44f8568" status: 202 len: 0 microversion: 2.1 time: 0.241635 Apr 14 13:25:07 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 235/693] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:25:07 2023] DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments/a20ffa11-b01c-45cc-8a71-f534c44f8568 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting quotas for project 8f0fee50983a4e31b1689dc77b1c4db1. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Getting quotas for user f04370605aec40a0a53a080c1e8bf8a8 and project 8f0fee50983a4e31b1689dc77b1c4db1. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:25:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:25:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d3754e24-5a5b-438a-9683-7056c2e26313 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.997851 Apr 14 13:25:08 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 230/694] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 13:25:07 2023] POST /compute/v2.1/servers => generated 400 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:25:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-937f4de8-4bdd-4873-a96a-86ae94420897 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:08 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-937f4de8-4bdd-4873-a96a-86ae94420897 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:08 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-937f4de8-4bdd-4873-a96a-86ae94420897 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:08 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-937f4de8-4bdd-4873-a96a-86ae94420897 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:08 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-937f4de8-4bdd-4873-a96a-86ae94420897 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-937f4de8-4bdd-4873-a96a-86ae94420897 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 200 len: 1275 microversion: 2.20 time: 0.068692 Apr 14 13:25:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 230/695] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:25:08 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 1275 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-97acc25e-8f91-4269-be1e-80297cc9955f tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062366 Apr 14 13:25:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 236/696] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:25:10 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-34813728-4751-467e-abda-f88708ea9370 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047137 Apr 14 13:25:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 231/697] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:25:10 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:25:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-22549b63-55b6-4671-91ad-fac54502fe0c tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85" status: 204 len: 0 microversion: 2.1 time: 0.116820 Apr 14 13:25:10 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 231/698] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:25:10 2023] DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7e4e432ab0d448db8c2437e40cbe0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a82aa8e6724a41e1a4e4d7783876536e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-15adcd12-1b63-4bff-b5d1-779d2790a1ef tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85" status: 200 len: 1660 microversion: 2.1 time: 0.324894 Apr 14 13:25:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 237/699] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:25:10 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 => generated 1660 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed09e4b4-dd5f-4200-be08-7260da0c7d85", "name": "network-vif-unplugged", "status": "completed", "tag": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] Creating event network-vif-unplugged:0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 on user Apr 14 13:25:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-affb6821-cec9-4f43-906e-088673d79b75 req-622b408b-c71d-4fbc-b574-a0773c61c03e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053176 Apr 14 13:25:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 232/700] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:11 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:11 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:11 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] Creating event network-changed:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:25:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-5b328bba-d8bf-45d6-a95b-7061b5d198af req-b4e90880-7a78-49c9-88bb-658b52115afa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034586 Apr 14 13:25:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 232/701] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:12 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed09e4b4-dd5f-4200-be08-7260da0c7d85", "name": "network-vif-plugged", "status": "completed", "tag": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] Creating event network-vif-plugged:0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 on user Apr 14 13:25:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0e49d6ea-91b2-4a16-b061-4a37ed323e3a req-c4700941-3966-4ba7-aea0-55acfe1dcedd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063122 Apr 14 13:25:13 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 238/702] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-ce21e4a7-c3f9-4431-a522-162ea993dc36 req-2987c76c-52ff-42c1-9d5d-bd15701fadb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed09e4b4-dd5f-4200-be08-7260da0c7d85", "name": "network-vif-deleted", "tag": "0a44c0e9-c717-4924-b996-4f0db4d1c1a3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ce21e4a7-c3f9-4431-a522-162ea993dc36 req-2987c76c-52ff-42c1-9d5d-bd15701fadb6 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ce21e4a7-c3f9-4431-a522-162ea993dc36 req-2987c76c-52ff-42c1-9d5d-bd15701fadb6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ce21e4a7-c3f9-4431-a522-162ea993dc36 req-2987c76c-52ff-42c1-9d5d-bd15701fadb6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-ce21e4a7-c3f9-4431-a522-162ea993dc36 req-2987c76c-52ff-42c1-9d5d-bd15701fadb6 service nova] Creating event network-vif-deleted:0a44c0e9-c717-4924-b996-4f0db4d1c1a3 for instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 on user Apr 14 13:25:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-ce21e4a7-c3f9-4431-a522-162ea993dc36 req-2987c76c-52ff-42c1-9d5d-bd15701fadb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031838 Apr 14 13:25:13 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 233/703] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-plugged", "status": "completed", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] Creating event network-vif-plugged:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:25:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-cf901526-7f94-4e83-9cd5-35e4557c2a5c req-ef627472-baf9-49f4-b022-4d0b9336fea7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039183 Apr 14 13:25:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 233/704] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:16 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-plugged", "status": "completed", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] Creating event network-vif-plugged:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:25:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-89aacac7-76ed-461c-8e1b-513e1da426ce req-87a7fce0-750e-4ac5-9383-de066e7ba16d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078854 Apr 14 13:25:16 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 239/705] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2015588570", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499"}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] validate_networks() for [('5bb34665-b8a7-4eb1-a250-c5b7ca33f499', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting quotas for project a573d19b775642bba2f2883e0005492d. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting quotas for user ebc2d46bc1794568841df20b046356c7 and project a573d19b775642bba2f2883e0005492d. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:25:20 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:25:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-1aef4c28-9d7c-4877-9f35-7ed4c22d8d71 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.633834 Apr 14 13:25:20 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 234/706] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 13:25:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:25:20 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:20 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e414d7e5-1a9b-4cb7-9e48-2a77134d3a42 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:20 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e414d7e5-1a9b-4cb7-9e48-2a77134d3a42 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:20 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-e414d7e5-1a9b-4cb7-9e48-2a77134d3a42 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:20 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-e414d7e5-1a9b-4cb7-9e48-2a77134d3a42 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:20 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-e414d7e5-1a9b-4cb7-9e48-2a77134d3a42 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e414d7e5-1a9b-4cb7-9e48-2a77134d3a42 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1" status: 200 len: 1395 microversion: 2.87 time: 0.074035 Apr 14 13:25:20 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 234/707] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:25:20 2023] GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1 => generated 1395 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:23 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ee707fa8-eb8e-40eb-87b5-3e0c1b72b291 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1747 microversion: 2.1 time: 0.265898 Apr 14 13:25:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 240/708] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:25:23 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1747 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:25:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "911be82f-bcf1-4b02-a218-ab977b28afe1", "tag": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] Creating event network-changed:98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance 911be82f-bcf1-4b02-a218-ab977b28afe1 on user Apr 14 13:25:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-4da04fcc-ed32-4419-ac26-49db276fd9ff req-7535f9a2-0a3d-42a8-a88b-253819044770 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046126 Apr 14 13:25:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 235/709] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:25 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911be82f-bcf1-4b02-a218-ab977b28afe1", "name": "network-vif-plugged", "status": "completed", "tag": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:25 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] Creating event network-vif-plugged:98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance 911be82f-bcf1-4b02-a218-ab977b28afe1 on user Apr 14 13:25:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-8c2bd64b-afab-4667-b83a-efeeb65f37d5 req-58ba6118-3543-4edc-a0e4-29cf5a331b72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Apr 14 13:25:25 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 235/710] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911be82f-bcf1-4b02-a218-ab977b28afe1", "name": "network-vif-plugged", "status": "completed", "tag": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:27 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] Creating event network-vif-plugged:98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance 911be82f-bcf1-4b02-a218-ab977b28afe1 on user Apr 14 13:25:27 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-16cf3aa3-c903-428c-abaa-48a26a33eee1 req-051f234d-4ebc-45d3-8377-2980df053318 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Apr 14 13:25:27 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 241/711] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] HTTP exception thrown: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Request method failure captured: Apr 14 13:25:27 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f HTTP/1.1 Apr 14 13:25:27 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:25:27 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:25:27 user devstack@n-api.service[61775]: Connection: close Apr 14 13:25:27 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:25:27 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:25:27 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:25:27 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:25:27 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVI3LyLT14ImRPIYeF6YAL3zUPp4aHdeRySuqatLcEpMh_Bcu61fTZDhqM3bjsg5-R5SaHgBHmQHjC-Xe8ZmGQ-dgPb8URDyOpCCHN4uhdgFYgCCC1jX1KH2yXZXpwHcqH1ITNDlTGk2hVOhLxkLt4q9tSMqGtjE-mav9O1H82Hlft4 Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Project-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Tenant: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Tenant-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:25:27 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:25:27 user devstack@n-api.service[61775]: X-User: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:25:27 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:25:27 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:25:27 user devstack@n-api.service[61775]: X-User-Id: 3f713f95191542f6a23ee25669061b27 Apr 14 13:25:27 user devstack@n-api.service[61775]: X-User-Name: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:25:27 user devstack@n-api.service[61775]: method: > Apr 14 13:25:27 user devstack@n-api.service[61775]: exception: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61775]: action_args: {'id': '1e06aa11-247c-48ff-adc2-f321e6c72f1f'} Apr 14 13:25:27 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Returning 404 to user: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:25:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b6e8f427-f50c-41dc-a21c-3334ed4ce8be tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f" status: 404 len: 111 microversion: 2.1 time: 0.036562 Apr 14 13:25:27 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 236/712] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:25:27 2023] DELETE /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 1e06aa11-247c-48ff-adc2-f321e6c72f1f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:27 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] HTTP exception thrown: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Request method failure captured: Apr 14 13:25:27 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f HTTP/1.1 Apr 14 13:25:27 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:25:27 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:25:27 user devstack@n-api.service[61774]: Connection: close Apr 14 13:25:27 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:25:27 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:25:27 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:25:27 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:25:27 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVI3LyLT14ImRPIYeF6YAL3zUPp4aHdeRySuqatLcEpMh_Bcu61fTZDhqM3bjsg5-R5SaHgBHmQHjC-Xe8ZmGQ-dgPb8URDyOpCCHN4uhdgFYgCCC1jX1KH2yXZXpwHcqH1ITNDlTGk2hVOhLxkLt4q9tSMqGtjE-mav9O1H82Hlft4 Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Project-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Project-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Tenant: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Tenant-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:25:27 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:25:27 user devstack@n-api.service[61774]: X-User: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:25:27 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:25:27 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:25:27 user devstack@n-api.service[61774]: X-User-Id: 3f713f95191542f6a23ee25669061b27 Apr 14 13:25:27 user devstack@n-api.service[61774]: X-User-Name: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:25:27 user devstack@n-api.service[61774]: method: > Apr 14 13:25:27 user devstack@n-api.service[61774]: exception: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61774]: action_args: {'id': '1e06aa11-247c-48ff-adc2-f321e6c72f1f'} Apr 14 13:25:27 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. Apr 14 13:25:27 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:25:27 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Returning 404 to user: Instance 1e06aa11-247c-48ff-adc2-f321e6c72f1f could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:25:27 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ebe71138-4e93-482a-ad18-7045b7c8c041 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f" status: 404 len: 111 microversion: 2.1 time: 0.033163 Apr 14 13:25:27 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 236/713] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:25:27 2023] GET /compute/v2.1/servers/1e06aa11-247c-48ff-adc2-f321e6c72f1f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:27 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:28 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:25:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f1a1b5b4-3057-4987-902b-4ea0836a65c8 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 204 len: 0 microversion: 2.1 time: 0.140086 Apr 14 13:25:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 242/714] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:25:27 2023] DELETE /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:28 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f713f95191542f6a23ee25669061b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4b4e44c0b8945079de567503aab3a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:28 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-cbfa4509-3b1d-44b6-a5a2-ddde92fd55d0 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 200 len: 1500 microversion: 2.1 time: 0.447125 Apr 14 13:25:28 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 237/715] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:25:28 2023] GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 1500 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:25:29 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847e2db8-10a7-416b-ae22-1c75b6d37817", "name": "network-vif-deleted", "tag": "af35aee5-c40d-47d2-82ea-3ff57c1d5495"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] Creating event network-vif-deleted:af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance 847e2db8-10a7-416b-ae22-1c75b6d37817 on user Apr 14 13:25:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-823743e6-4371-4e9f-afc7-f31e8bed26c9 req-de41d646-b93b-4327-9205-874ebdf74f93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045685 Apr 14 13:25:29 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 237/716] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847e2db8-10a7-416b-ae22-1c75b6d37817", "name": "network-vif-unplugged", "status": "completed", "tag": "af35aee5-c40d-47d2-82ea-3ff57c1d5495"}, {"server_uuid": "847e2db8-10a7-416b-ae22-1c75b6d37817", "name": "network-vif-plugged", "status": "completed", "tag": "af35aee5-c40d-47d2-82ea-3ff57c1d5495"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Creating event network-vif-unplugged:af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance 847e2db8-10a7-416b-ae22-1c75b6d37817 on user Apr 14 13:25:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] Creating event network-vif-plugged:af35aee5-c40d-47d2-82ea-3ff57c1d5495 for instance 847e2db8-10a7-416b-ae22-1c75b6d37817 on user Apr 14 13:25:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-7fe5b627-425f-4ced-a72f-af41305c07e4 req-fef013ac-2cd0-44fc-a3b4-c156dfb49504 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.067702 Apr 14 13:25:29 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 243/717] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=7 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:47 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0481ae7b-6d7a-429d-8bad-29aa4ef55230 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 200 len: 1716 microversion: 2.1 time: 0.243775 Apr 14 13:25:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 238/718] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:25:47 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 1716 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=15 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-f2cf7f10-5506-4a8b-8aea-62d4e7f8ca22 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049946 Apr 14 13:25:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 238/719] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:25:57 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:57 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:25:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d38416ac-84af-49eb-970f-02d44c5a9f3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468" status: 204 len: 0 microversion: 2.1 time: 0.141309 Apr 14 13:25:57 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 244/720] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:25:57 2023] DELETE /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f10bee-45ba-4541-8af8-e392018ef468", "name": "network-vif-unplugged", "status": "completed", "tag": "45024c25-a182-4df9-bec0-ab8dc8354659"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:57 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65812c6559684eddbdde33cd64ca1fba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6833a69217034c4d85ff10bf8aa2fa5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ef575b3b-5733-4ede-af55-19d9d9625e30 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468" status: 200 len: 1670 microversion: 2.1 time: 0.268617 Apr 14 13:25:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 239/721] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:25:57 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 => generated 1670 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:25:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] Creating event network-vif-unplugged:45024c25-a182-4df9-bec0-ab8dc8354659 for instance 01f10bee-45ba-4541-8af8-e392018ef468 on user Apr 14 13:25:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-a75fe7b0-7c77-4c5d-ab49-1b3dd1108533 req-a8daec3d-6770-48f9-b767-3eb0a03107f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041507 Apr 14 13:25:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 239/722] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:58 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-807efef6-b8f2-415e-83f5-52e1b504eb1c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 200 len: 1586 microversion: 2.20 time: 0.232946 Apr 14 13:25:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 245/723] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:25:58 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 1586 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:25:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:25:58 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:59 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:25:59 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-abfbe756-37e6-4d7d-96ae-e22f54c718f3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3" status: 200 len: 1393 microversion: 2.1 time: 0.271120 Apr 14 13:25:59 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 240/724] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:25:58 2023] GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 => generated 1393 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-237936391"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:59 user devstack@n-api.service[61774]: INFO nova.compute.api [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Attempting to quiesce instance before volume snapshot. Apr 14 13:25:59 user devstack@n-api.service[61774]: INFO nova.compute.api [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 13:25:59 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Creating snapshot from volume fa06c410-d2f3-4211-98a9-d8bae7d21b29. {{(pid=61774) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 13:25:59 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f10bee-45ba-4541-8af8-e392018ef468", "name": "network-vif-plugged", "status": "completed", "tag": "45024c25-a182-4df9-bec0-ab8dc8354659"}, {"server_uuid": "01f10bee-45ba-4541-8af8-e392018ef468", "name": "network-vif-deleted", "tag": "45024c25-a182-4df9-bec0-ab8dc8354659"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:25:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:25:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:25:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:25:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Creating event network-vif-plugged:45024c25-a182-4df9-bec0-ab8dc8354659 for instance 01f10bee-45ba-4541-8af8-e392018ef468 on user Apr 14 13:25:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] Creating event network-vif-deleted:45024c25-a182-4df9-bec0-ab8dc8354659 for instance 01f10bee-45ba-4541-8af8-e392018ef468 on user Apr 14 13:25:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-adeb27a1-34d9-4a91-b603-70d758be69d6 req-3051b693-e7e5-457c-a469-8740084551d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028978 Apr 14 13:25:59 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 246/725] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:25:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:00 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HTTP exception thrown: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Request method failure captured: Apr 14 13:26:00 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 HTTP/1.1 Apr 14 13:26:00 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:26:00 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:26:00 user devstack@n-api.service[61775]: Connection: close Apr 14 13:26:00 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:26:00 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:26:00 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:26:00 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:26:00 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVEyICtTDp5n9aq_Z_1afPSypXpMhY0jB7yFs0dhGODD-dq5DmHr-lD12CP9OGmkVhIpxfm18Z2aW2UXW_Ghjkv3zaINayJy_ZXwX64fZ2_5kCGv7dkU8n8cuG_XwjVIV4efuCsIhmiC4Ca9qCHsD-goCAhLNYF1nJz1a5QEUv2dGUY Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Project-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Tenant-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:00 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:00 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:00 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:26:00 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:26:00 user devstack@n-api.service[61775]: X-User-Id: d7e4e432ab0d448db8c2437e40cbe0cd Apr 14 13:26:00 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:00 user devstack@n-api.service[61775]: method: > Apr 14 13:26:00 user devstack@n-api.service[61775]: exception: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:00 user devstack@n-api.service[61775]: action_args: {'id': 'ed09e4b4-dd5f-4200-be08-7260da0c7d85'} Apr 14 13:26:00 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:00 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:00 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Returning 404 to user: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:00 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9233be51-2651-44a9-8a0b-74a78bb8904d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85" status: 404 len: 111 microversion: 2.1 time: 0.036433 Apr 14 13:26:00 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 241/726] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:00 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 13:26:00 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7474c8c3-0829-4f1f-8404-9f28ab17572b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '.version_select at 0x7fa743b84820>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:00 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7474c8c3-0829-4f1f-8404-9f28ab17572b tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-531734162" status: 202 len: 0 microversion: 2.1 time: 0.022365 Apr 14 13:26:00 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 247/727] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:26:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-531734162 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:26:01 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:01 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:01 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:02 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ab8e0a24-20c7-4efa-b9b5-c431d84704d5 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1676 microversion: 2.1 time: 0.239914 Apr 14 13:26:02 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 242/728] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:01 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:26:02 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3452b973-eab5-49dc-b950-2f515a6c4f1b"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:02 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:02 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7ee9a14a-5a8d-4e64-a308-ff582e873157 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "POST /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3/action" status: 202 len: 0 microversion: 2.1 time: 2.932602 Apr 14 13:26:02 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 240/729] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:25:59 2023] POST /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3/action => generated 0 bytes in 2934 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-825541492", "imageRef": "b79415a7-1028-47c9-b6c3-8a8a7bfce629", "flavorRef": "42", "networks": [{"uuid": "32e04661-5709-44d8-b16f-bc45b62317fc"}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:02 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-1788769d-e163-41a0-b872-3ada94a56e8f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296384 Apr 14 13:26:02 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 248/730] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:26:02 2023] POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] validate_networks() for [('32e04661-5709-44d8-b16f-bc45b62317fc', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for user bb40413bd0c3490d97b997f69c930f72 and project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:26:02 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='a67e5756-f222-42a3-915a-f268d7eef3b2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:26:02 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-00e38549-b487-4b80-9ebf-77fa2ea7c124 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.564438 Apr 14 13:26:02 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 243/731] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:26:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:26:02 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3efef5bb-44b5-4a9a-9219-db5d0111cb82 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:02 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-3efef5bb-44b5-4a9a-9219-db5d0111cb82 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:02 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-3efef5bb-44b5-4a9a-9219-db5d0111cb82 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-3efef5bb-44b5-4a9a-9219-db5d0111cb82 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24" status: 200 len: 1223 microversion: 2.1 time: 0.091819 Apr 14 13:26:03 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 241/732] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:02 2023] GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:26:06 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8fbde75-cf77-4069-91ac-9d9c92c65c24", "tag": "643e5d33-1456-403f-ba06-e25ec6713e7d"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] Creating event network-changed:643e5d33-1456-403f-ba06-e25ec6713e7d for instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 on user Apr 14 13:26:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f849f02b-f580-42b9-8f2a-16fb813fa109 req-236b72c4-bbda-4c07-9267-3a9257a1ac9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032518 Apr 14 13:26:06 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 249/733] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HTTP exception thrown: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Request method failure captured: Apr 14 13:26:08 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 HTTP/1.1 Apr 14 13:26:08 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:26:08 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:26:08 user devstack@n-api.service[61775]: Connection: close Apr 14 13:26:08 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:26:08 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:26:08 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:26:08 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:26:08 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVEyICtTDp5n9aq_Z_1afPSypXpMhY0jB7yFs0dhGODD-dq5DmHr-lD12CP9OGmkVhIpxfm18Z2aW2UXW_Ghjkv3zaINayJy_ZXwX64fZ2_5kCGv7dkU8n8cuG_XwjVIV4efuCsIhmiC4Ca9qCHsD-goCAhLNYF1nJz1a5QEUv2dGUY Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Project-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Tenant-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:08 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:08 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:08 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:26:08 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:26:08 user devstack@n-api.service[61775]: X-User-Id: d7e4e432ab0d448db8c2437e40cbe0cd Apr 14 13:26:08 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:08 user devstack@n-api.service[61775]: method: > Apr 14 13:26:08 user devstack@n-api.service[61775]: exception: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61775]: action_args: {'id': 'ed09e4b4-dd5f-4200-be08-7260da0c7d85'} Apr 14 13:26:08 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Returning 404 to user: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-484929a0-7f14-4770-8e13-a1d5784cd19d tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85" status: 404 len: 111 microversion: 2.1 time: 0.027600 Apr 14 13:26:08 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 244/734] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:26:08 2023] DELETE /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: ed09e4b4-dd5f-4200-be08-7260da0c7d85] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HTTP exception thrown: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Request method failure captured: Apr 14 13:26:08 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 HTTP/1.1 Apr 14 13:26:08 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:26:08 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:26:08 user devstack@n-api.service[61774]: Connection: close Apr 14 13:26:08 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:26:08 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:26:08 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:26:08 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:26:08 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVEyICtTDp5n9aq_Z_1afPSypXpMhY0jB7yFs0dhGODD-dq5DmHr-lD12CP9OGmkVhIpxfm18Z2aW2UXW_Ghjkv3zaINayJy_ZXwX64fZ2_5kCGv7dkU8n8cuG_XwjVIV4efuCsIhmiC4Ca9qCHsD-goCAhLNYF1nJz1a5QEUv2dGUY Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Project-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Tenant-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:08 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:08 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:08 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:26:08 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:26:08 user devstack@n-api.service[61774]: X-User-Id: d7e4e432ab0d448db8c2437e40cbe0cd Apr 14 13:26:08 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:08 user devstack@n-api.service[61774]: method: > Apr 14 13:26:08 user devstack@n-api.service[61774]: exception: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61774]: action_args: {'id': 'ed09e4b4-dd5f-4200-be08-7260da0c7d85'} Apr 14 13:26:08 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. Apr 14 13:26:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Returning 404 to user: Instance ed09e4b4-dd5f-4200-be08-7260da0c7d85 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-bf2eff44-cf64-48d6-b731-0f75f27fce5e tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85" status: 404 len: 111 microversion: 2.1 time: 0.049471 Apr 14 13:26:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 242/735] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:08 2023] GET /compute/v2.1/servers/ed09e4b4-dd5f-4200-be08-7260da0c7d85 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Old instance type m1.nano, new instance type m1.micro {{(pid=61776) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for project 4b197f1df57f4dee9757639cf861eb97. Resources: {'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for user 9169729edbd04fd5a74d2cffd0aa437f and project 4b197f1df57f4dee9757639cf861eb97. Resources: {'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:26:10 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:26:10 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4a26f3fa-a257-42a1-b750-57d9c80347e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/action" status: 202 len: 0 microversion: 2.1 time: 0.449235 Apr 14 13:26:10 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 250/736] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:26:10 2023] POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:10 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-7961e133-5f0a-41b2-a305-1043b8742fd2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1731 microversion: 2.1 time: 0.231067 Apr 14 13:26:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 245/737] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:10 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:26:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:10 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:11 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b1a2afce-1e9b-4320-a878-512d20366d4a tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1" status: 200 len: 1690 microversion: 2.87 time: 0.272821 Apr 14 13:26:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 243/738] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:26:10 2023] GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1 => generated 1690 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:11 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HTTP exception thrown: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Request method failure captured: Apr 14 13:26:11 user devstack@n-api.service[61776]: request: DELETE /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 HTTP/1.1 Apr 14 13:26:11 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:26:11 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:26:11 user devstack@n-api.service[61776]: Connection: close Apr 14 13:26:11 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:26:11 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:26:11 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:26:11 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:26:11 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVEyICtTDp5n9aq_Z_1afPSypXpMhY0jB7yFs0dhGODD-dq5DmHr-lD12CP9OGmkVhIpxfm18Z2aW2UXW_Ghjkv3zaINayJy_ZXwX64fZ2_5kCGv7dkU8n8cuG_XwjVIV4efuCsIhmiC4Ca9qCHsD-goCAhLNYF1nJz1a5QEUv2dGUY Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Project-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Tenant-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:11 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:11 user devstack@n-api.service[61776]: X-User: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:11 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:26:11 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:26:11 user devstack@n-api.service[61776]: X-User-Id: d7e4e432ab0d448db8c2437e40cbe0cd Apr 14 13:26:11 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:11 user devstack@n-api.service[61776]: method: > Apr 14 13:26:11 user devstack@n-api.service[61776]: exception: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61776]: action_args: {'id': '84bf295a-37fa-4463-bddb-38ac2c5d2cf7'} Apr 14 13:26:11 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Returning 404 to user: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:11 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9da826de-3d24-40a2-8b6f-f4e9188c5363 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 404 len: 111 microversion: 2.1 time: 0.037513 Apr 14 13:26:11 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 251/739] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:26:11 2023] DELETE /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] [instance: 84bf295a-37fa-4463-bddb-38ac2c5d2cf7] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:11 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] HTTP exception thrown: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Request method failure captured: Apr 14 13:26:11 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 HTTP/1.1 Apr 14 13:26:11 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:26:11 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:26:11 user devstack@n-api.service[61775]: Connection: close Apr 14 13:26:11 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:26:11 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:26:11 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:26:11 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:26:11 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVEyICtTDp5n9aq_Z_1afPSypXpMhY0jB7yFs0dhGODD-dq5DmHr-lD12CP9OGmkVhIpxfm18Z2aW2UXW_Ghjkv3zaINayJy_ZXwX64fZ2_5kCGv7dkU8n8cuG_XwjVIV4efuCsIhmiC4Ca9qCHsD-goCAhLNYF1nJz1a5QEUv2dGUY Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Project-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a82aa8e6724a41e1a4e4d7783876536e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Tenant-Id: a82aa8e6724a41e1a4e4d7783876536e Apr 14 13:26:11 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeTestJSON-581564101 Apr 14 13:26:11 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:11 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:26:11 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:26:11 user devstack@n-api.service[61775]: X-User-Id: d7e4e432ab0d448db8c2437e40cbe0cd Apr 14 13:26:11 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeTestJSON-581564101-project-member Apr 14 13:26:11 user devstack@n-api.service[61775]: method: > Apr 14 13:26:11 user devstack@n-api.service[61775]: exception: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61775]: action_args: {'id': '84bf295a-37fa-4463-bddb-38ac2c5d2cf7'} Apr 14 13:26:11 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. Apr 14 13:26:11 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:11 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] Returning 404 to user: Instance 84bf295a-37fa-4463-bddb-38ac2c5d2cf7 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:11 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e082c986-5434-4ed1-9001-87fa6c8916e1 tempest-AttachVolumeTestJSON-581564101 tempest-AttachVolumeTestJSON-581564101-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7" status: 404 len: 111 microversion: 2.1 time: 0.039085 Apr 14 13:26:11 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 246/740] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:11 2023] GET /compute/v2.1/servers/84bf295a-37fa-4463-bddb-38ac2c5d2cf7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-unplugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:13 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Creating event network-vif-unplugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:26:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61774) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:26:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-75286b2d-c642-4140-9133-18e4ed3d0971 req-c0646ebc-aac2-45e0-9295-b00cc9c58fe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084484 Apr 14 13:26:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 244/741] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:16 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:26:16 user devstack@n-api.service[61776]: DEBUG nova.compute.api [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:26:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-19f7aac8-d4f6-42cd-b4db-3b164fec5bd9 req-631e2c60-bcde-4a30-8444-772a5d7ba8ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048549 Apr 14 13:26:16 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 252/742] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] [instance: 847e2db8-10a7-416b-ae22-1c75b6d37817] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=39 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] HTTP exception thrown: Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 could not be found. Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Request method failure captured: Apr 14 13:26:18 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 HTTP/1.1 Apr 14 13:26:18 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:26:18 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:26:18 user devstack@n-api.service[61775]: Connection: close Apr 14 13:26:18 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:26:18 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:26:18 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:26:18 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:26:18 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVI3LyLT14ImRPIYeF6YAL3zUPp4aHdeRySuqatLcEpMh_Bcu61fTZDhqM3bjsg5-R5SaHgBHmQHjC-Xe8ZmGQ-dgPb8URDyOpCCHN4uhdgFYgCCC1jX1KH2yXZXpwHcqH1ITNDlTGk2hVOhLxkLt4q9tSMqGtjE-mav9O1H82Hlft4 Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Project-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d4b4e44c0b8945079de567503aab3a12"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Tenant: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Tenant-Id: d4b4e44c0b8945079de567503aab3a12 Apr 14 13:26:18 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServersNegativeTestJSON-548588779 Apr 14 13:26:18 user devstack@n-api.service[61775]: X-User: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:26:18 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:26:18 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:26:18 user devstack@n-api.service[61775]: X-User-Id: 3f713f95191542f6a23ee25669061b27 Apr 14 13:26:18 user devstack@n-api.service[61775]: X-User-Name: tempest-ServersNegativeTestJSON-548588779-project-member Apr 14 13:26:18 user devstack@n-api.service[61775]: method: > Apr 14 13:26:18 user devstack@n-api.service[61775]: exception: Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 could not be found. Apr 14 13:26:18 user devstack@n-api.service[61775]: action_args: {'id': '847e2db8-10a7-416b-ae22-1c75b6d37817'} Apr 14 13:26:18 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 could not be found. Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 could not be found. Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 could not be found. Apr 14 13:26:18 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] Returning 404 to user: Instance 847e2db8-10a7-416b-ae22-1c75b6d37817 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-02ed56e4-2b46-4cf2-a9f7-43fbf5e18dd9 tempest-ServersNegativeTestJSON-548588779 tempest-ServersNegativeTestJSON-548588779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817" status: 404 len: 111 microversion: 2.1 time: 0.044764 Apr 14 13:26:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 247/743] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:18 2023] GET /compute/v2.1/servers/847e2db8-10a7-416b-ae22-1c75b6d37817 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fbde75-cf77-4069-91ac-9d9c92c65c24", "name": "network-vif-plugged", "status": "completed", "tag": "643e5d33-1456-403f-ba06-e25ec6713e7d"}, {"server_uuid": "b8fbde75-cf77-4069-91ac-9d9c92c65c24", "name": "network-vif-plugged", "status": "completed", "tag": "643e5d33-1456-403f-ba06-e25ec6713e7d"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Creating event network-vif-plugged:643e5d33-1456-403f-ba06-e25ec6713e7d for instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 on user Apr 14 13:26:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] Creating event network-vif-plugged:643e5d33-1456-403f-ba06-e25ec6713e7d for instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 on user Apr 14 13:26:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-242a498e-d352-45e2-8207-a9e85f856437 req-43df181f-a8d6-421d-bc27-4f1391751881 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044509 Apr 14 13:26:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 245/744] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=3 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2e165fb1-515b-4eb3-af7a-dbc5f22832e1 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Action: 'create', calling method: .version_select at 0x7fa7438dca60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1936799451", "metadata": {"Type": "work"}}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2e165fb1-515b-4eb3-af7a-dbc5f22832e1 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Request method failure captured: Apr 14 13:26:23 user devstack@n-api.service[61776]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 13:26:23 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:26:23 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:26:23 user devstack@n-api.service[61776]: Connection: close Apr 14 13:26:23 user devstack@n-api.service[61776]: Content-Length: 122 Apr 14 13:26:23 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:26:23 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:26:23 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:26:23 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVR_Lnhgn1X4qOVDMzFF0KtRNnwmYrIBQMzC1LXmP9tSRU_42BZEaEcb4eEQ4M3BHZeirjJV4FOA-03hav2e7D4BlXU4R6Yy8POy-Lt1hEDgr1JrO9Wbk8bIo3auLIkN3jo-yQu16OcwIQy4pYecpfhLIcsGYC1dyLxbKTVf6f9LXMg Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c210242c7757431084b347d2bb44904c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Id: 518748134ed54f2c92685e785f0e7ffb Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61776]: Apr 14 13:26:23 user devstack@n-api.service[61776]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1936799451", "metadata": {"Type": "work"}}} Apr 14 13:26:23 user devstack@n-api.service[61776]: method: Apr 14 13:26:23 user devstack@n-api.service[61776]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 13:26:23 user devstack@n-api.service[61776]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1936799451', 'metadata': {'Type': 'work'}}}} Apr 14 13:26:23 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise error Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2e165fb1-515b-4eb3-af7a-dbc5f22832e1 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2e165fb1-515b-4eb3-af7a-dbc5f22832e1 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.208619 Apr 14 13:26:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 253/745] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 13:26:23 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9a854c4f-af14-4ebc-900a-1255c16f3e56 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Action: 'create', calling method: .version_select at 0x7fa7438af640>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-806103267", "metadata": {"Type": "work"}}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9a854c4f-af14-4ebc-900a-1255c16f3e56 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Request method failure captured: Apr 14 13:26:23 user devstack@n-api.service[61775]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 13:26:23 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:26:23 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:26:23 user devstack@n-api.service[61775]: Connection: close Apr 14 13:26:23 user devstack@n-api.service[61775]: Content-Length: 119 Apr 14 13:26:23 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:26:23 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:26:23 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:26:23 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVR_Lnhgn1X4qOVDMzFF0KtRNnwmYrIBQMzC1LXmP9tSRU_42BZEaEcb4eEQ4M3BHZeirjJV4FOA-03hav2e7D4BlXU4R6Yy8POy-Lt1hEDgr1JrO9Wbk8bIo3auLIkN3jo-yQu16OcwIQy4pYecpfhLIcsGYC1dyLxbKTVf6f9LXMg Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Project-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Project-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c210242c7757431084b347d2bb44904c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Tenant: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Tenant-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61775]: X-User: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61775]: X-User-Id: 518748134ed54f2c92685e785f0e7ffb Apr 14 13:26:23 user devstack@n-api.service[61775]: X-User-Name: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61775]: Apr 14 13:26:23 user devstack@n-api.service[61775]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-806103267", "metadata": {"Type": "work"}}} Apr 14 13:26:23 user devstack@n-api.service[61775]: method: Apr 14 13:26:23 user devstack@n-api.service[61775]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 13:26:23 user devstack@n-api.service[61775]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-806103267', 'metadata': {'Type': 'work'}}}} Apr 14 13:26:23 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise error Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi '0' Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 13:26:23 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9a854c4f-af14-4ebc-900a-1255c16f3e56 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9a854c4f-af14-4ebc-900a-1255c16f3e56 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011193 Apr 14 13:26:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 248/746] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 13:26:23 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:26:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4e0f3858-470a-4438-a4bc-17f2bdc46ff3 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Action: 'create', calling method: .version_select at 0x7fa743796170>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-521777464", "metadata": {"Type": "work"}}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4e0f3858-470a-4438-a4bc-17f2bdc46ff3 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Request method failure captured: Apr 14 13:26:23 user devstack@n-api.service[61774]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 13:26:23 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:26:23 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:26:23 user devstack@n-api.service[61774]: Connection: close Apr 14 13:26:23 user devstack@n-api.service[61774]: Content-Length: 118 Apr 14 13:26:23 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:26:23 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:26:23 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:26:23 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVR_Lnhgn1X4qOVDMzFF0KtRNnwmYrIBQMzC1LXmP9tSRU_42BZEaEcb4eEQ4M3BHZeirjJV4FOA-03hav2e7D4BlXU4R6Yy8POy-Lt1hEDgr1JrO9Wbk8bIo3auLIkN3jo-yQu16OcwIQy4pYecpfhLIcsGYC1dyLxbKTVf6f9LXMg Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Project-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Project-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c210242c7757431084b347d2bb44904c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Tenant: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Tenant-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User-Id: 518748134ed54f2c92685e785f0e7ffb Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User-Name: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61774]: Apr 14 13:26:23 user devstack@n-api.service[61774]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-521777464", "metadata": {"Type": "work"}}} Apr 14 13:26:23 user devstack@n-api.service[61774]: method: Apr 14 13:26:23 user devstack@n-api.service[61774]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 13:26:23 user devstack@n-api.service[61774]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-521777464', 'metadata': {'Type': 'work'}}}} Apr 14 13:26:23 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise error Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi '' Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4e0f3858-470a-4438-a4bc-17f2bdc46ff3 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:23 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-4e0f3858-470a-4438-a4bc-17f2bdc46ff3 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013243 Apr 14 13:26:23 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 246/747] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 13:26:23 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e678aeea-a1a4-4010-9969-cabaa16b1691 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Calling method '.version_select at 0x7fa7438de560>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1705894697"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-e678aeea-a1a4-4010-9969-cabaa16b1691 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] HTTP exception thrown: Volume tempest-invalid-1537042544 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e678aeea-a1a4-4010-9969-cabaa16b1691 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Request method failure captured: Apr 14 13:26:23 user devstack@n-api.service[61776]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1537042544 HTTP/1.1 Apr 14 13:26:23 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:26:23 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:26:23 user devstack@n-api.service[61776]: Connection: close Apr 14 13:26:23 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:26:23 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:26:23 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:26:23 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:26:23 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVR_Lnhgn1X4qOVDMzFF0KtRNnwmYrIBQMzC1LXmP9tSRU_42BZEaEcb4eEQ4M3BHZeirjJV4FOA-03hav2e7D4BlXU4R6Yy8POy-Lt1hEDgr1JrO9Wbk8bIo3auLIkN3jo-yQu16OcwIQy4pYecpfhLIcsGYC1dyLxbKTVf6f9LXMg Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c210242c7757431084b347d2bb44904c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Id: 518748134ed54f2c92685e785f0e7ffb Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61776]: method: Apr 14 13:26:23 user devstack@n-api.service[61776]: exception: Volume tempest-invalid-1537042544 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: action_args: {'id': 'tempest-invalid-1537042544'} Apr 14 13:26:23 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1537042544 could not be found. (HTTP 404) (Request-ID: req-30135c4b-10f9-4197-9d85-37d964150494) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1537042544 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1537042544 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1537042544 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e678aeea-a1a4-4010-9969-cabaa16b1691 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Returning 404 to user: Volume tempest-invalid-1537042544 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e678aeea-a1a4-4010-9969-cabaa16b1691 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1537042544" status: 404 len: 99 microversion: 2.1 time: 0.045270 Apr 14 13:26:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 254/748] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:26:23 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1537042544 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 14 13:26:23 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-01dbb914-ffaf-4832-b116-a52b8697d115 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004428 Apr 14 13:26:23 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 247/749] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 13:26:23 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 13:26:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-00f00138-d765-4785-af00-aeb006c3a4c6 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004436 Apr 14 13:26:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 255/750] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 13:26:23 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 13:26:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c3aada50-dee6-4560-8e98-d946b5c505e0 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Calling method '.version_select at 0x7fa743624dc0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:23 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-c3aada50-dee6-4560-8e98-d946b5c505e0 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] HTTP exception thrown: Volume 2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca could not be found. Apr 14 13:26:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c3aada50-dee6-4560-8e98-d946b5c505e0 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Request method failure captured: Apr 14 13:26:23 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/os-volumes/2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca HTTP/1.1 Apr 14 13:26:23 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:26:23 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:26:23 user devstack@n-api.service[61774]: Connection: close Apr 14 13:26:23 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:26:23 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:26:23 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:26:23 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:26:23 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVR_Lnhgn1X4qOVDMzFF0KtRNnwmYrIBQMzC1LXmP9tSRU_42BZEaEcb4eEQ4M3BHZeirjJV4FOA-03hav2e7D4BlXU4R6Yy8POy-Lt1hEDgr1JrO9Wbk8bIo3auLIkN3jo-yQu16OcwIQy4pYecpfhLIcsGYC1dyLxbKTVf6f9LXMg Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Project-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Project-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c210242c7757431084b347d2bb44904c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Tenant: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Tenant-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User-Id: 518748134ed54f2c92685e785f0e7ffb Apr 14 13:26:23 user devstack@n-api.service[61774]: X-User-Name: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61774]: method: Apr 14 13:26:23 user devstack@n-api.service[61774]: exception: Volume 2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca could not be found. Apr 14 13:26:23 user devstack@n-api.service[61774]: action_args: {'id': '2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca'} Apr 14 13:26:23 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca could not be found. (HTTP 404) (Request-ID: req-1488ff28-2861-44cf-8b68-16507aadf2f4) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca could not be found. Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca could not be found. Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca could not be found. Apr 14 13:26:23 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c3aada50-dee6-4560-8e98-d946b5c505e0 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Returning 404 to user: Volume 2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:23 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c3aada50-dee6-4560-8e98-d946b5c505e0 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca" status: 404 len: 109 microversion: 2.1 time: 0.043750 Apr 14 13:26:23 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 248/751] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:26:23 2023] DELETE /compute/v2.1/os-volumes/2437b2f9-08fb-4cbb-b2e0-a05be2ea7bca => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b6b7db93-9f14-4290-96b3-ec6c1c950393 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Calling method '.version_select at 0x7fa74381c700>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-b6b7db93-9f14-4290-96b3-ec6c1c950393 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] HTTP exception thrown: Volume 4220b742-16d9-4b95-9093-0ff29fca7f65 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b6b7db93-9f14-4290-96b3-ec6c1c950393 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Request method failure captured: Apr 14 13:26:23 user devstack@n-api.service[61776]: request: GET /compute/v2.1/os-volumes/4220b742-16d9-4b95-9093-0ff29fca7f65 HTTP/1.1 Apr 14 13:26:23 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:26:23 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:26:23 user devstack@n-api.service[61776]: Connection: close Apr 14 13:26:23 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:26:23 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:26:23 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:26:23 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:26:23 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVR_Lnhgn1X4qOVDMzFF0KtRNnwmYrIBQMzC1LXmP9tSRU_42BZEaEcb4eEQ4M3BHZeirjJV4FOA-03hav2e7D4BlXU4R6Yy8POy-Lt1hEDgr1JrO9Wbk8bIo3auLIkN3jo-yQu16OcwIQy4pYecpfhLIcsGYC1dyLxbKTVf6f9LXMg Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c210242c7757431084b347d2bb44904c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c210242c7757431084b347d2bb44904c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant-Id: c210242c7757431084b347d2bb44904c Apr 14 13:26:23 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesNegativeTest-1410194644 Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Id: 518748134ed54f2c92685e785f0e7ffb Apr 14 13:26:23 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesNegativeTest-1410194644-project-member Apr 14 13:26:23 user devstack@n-api.service[61776]: method: Apr 14 13:26:23 user devstack@n-api.service[61776]: exception: Volume 4220b742-16d9-4b95-9093-0ff29fca7f65 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: action_args: {'id': '4220b742-16d9-4b95-9093-0ff29fca7f65'} Apr 14 13:26:23 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4220b742-16d9-4b95-9093-0ff29fca7f65 could not be found. (HTTP 404) (Request-ID: req-1ef63caf-f140-4980-bc36-11b7248fa310) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4220b742-16d9-4b95-9093-0ff29fca7f65 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4220b742-16d9-4b95-9093-0ff29fca7f65 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4220b742-16d9-4b95-9093-0ff29fca7f65 could not be found. Apr 14 13:26:23 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b6b7db93-9f14-4290-96b3-ec6c1c950393 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] Returning 404 to user: Volume 4220b742-16d9-4b95-9093-0ff29fca7f65 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-b6b7db93-9f14-4290-96b3-ec6c1c950393 tempest-VolumesNegativeTest-1410194644 tempest-VolumesNegativeTest-1410194644-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4220b742-16d9-4b95-9093-0ff29fca7f65" status: 404 len: 109 microversion: 2.1 time: 0.041616 Apr 14 13:26:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 256/752] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:26:23 2023] GET /compute/v2.1/os-volumes/4220b742-16d9-4b95-9093-0ff29fca7f65 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:24 user devstack@n-api.service[61775]: INFO nova.network.security_group_api [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Removing security group a7c19468-44d9-4a4d-94d3-784976b649ad from port bcff28e3-32d8-4f26-b087-4b1082f06cfb Apr 14 13:26:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-f8918087-e84a-42da-8048-489d0bac9afd tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/action" status: 202 len: 0 microversion: 2.1 time: 0.825163 Apr 14 13:26:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 249/753] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:26:23 2023] POST /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/action => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:26:24 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49467859-954f-498d-b520-587c7f38effc", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] Creating event network-changed:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:26:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-af907008-7da7-4a7f-9f92-5f465a5c21a1 req-bc807c04-b7a5-4154-807a-ddb0a2ad8f86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044348 Apr 14 13:26:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 249/754] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49467859-954f-498d-b520-587c7f38effc", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] Creating event network-changed:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:26:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-6b8bc7a3-0e5c-4cc2-a7a5-afaf0a65dba5 req-44bbbb18-17f2-40b5-833d-76ef2a186403 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070894 Apr 14 13:26:26 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 257/755] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:26 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'services' on Instance uuid 49467859-954f-498d-b520-587c7f38effc {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:26:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-db805643-0393-4e72-992d-014f6d53624f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments/fcdfe359-4681-4ebf-847d-85edfd26edc0" status: 202 len: 0 microversion: 2.1 time: 0.206276 Apr 14 13:26:26 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 250/756] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:26:26 2023] DELETE /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments/fcdfe359-4681-4ebf-847d-85edfd26edc0 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:26:26 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:26 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1f9e04c3-cc9a-4065-9ccb-cd43fefc0a94 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092773 Apr 14 13:26:26 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 250/757] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:26:26 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}, {"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:26:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:26:26 user devstack@n-api.service[61776]: DEBUG nova.compute.api [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:26:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-7c2e491b-28e5-4cea-a506-c20ebe339248 req-3cb84589-2ec4-4fba-876b-5cb533abd822 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066346 Apr 14 13:26:26 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 258/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:44 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=5 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:44 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-2bac5b64-8765-4691-9c8e-a85a38829920 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Action: 'create', calling method: .version_select at 0x7fa743beaa70>, body: {"keypair": {"name": "tempest-TestStampPattern-924006334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIm4aARBA4lAX/hfwMD4oBZFv2cTXlcgSngjcTEDIv9RAHTvjbNkAIIQYYwrK0JxNUWLzReMonMtMkMBWIgzI882038PhtWRli7iqrN9dwPmOnFtL9wStfKPVLf4sjHM0w=="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:45 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-2bac5b64-8765-4691-9c8e-a85a38829920 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting quotas for project fdd6e06c2dbf479697403fee2b1b72e2. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:26:45 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-2bac5b64-8765-4691-9c8e-a85a38829920 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting quotas for user d53a298063a346ec9b41110051e689c8 and project fdd6e06c2dbf479697403fee2b1b72e2. Resources: {'key_pairs'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:26:45 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-2bac5b64-8765-4691-9c8e-a85a38829920 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.221715 Apr 14 13:26:45 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 251/759] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:26:44 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=24 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:26:47 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 HTTP/1.1 Apr 14 13:26:47 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:26:47 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:26:47 user devstack@n-api.service[61774]: Connection: close Apr 14 13:26:47 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:26:47 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:26:47 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:26:47 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:26:47 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:47 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:47 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:47 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:26:47 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:26:47 user devstack@n-api.service[61774]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:26:47 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:47 user devstack@n-api.service[61774]: method: > Apr 14 13:26:47 user devstack@n-api.service[61774]: exception: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:47 user devstack@n-api.service[61774]: action_args: {'id': '01f10bee-45ba-4541-8af8-e392018ef468'} Apr 14 13:26:47 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:47 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e9ae349d-c8fb-427a-a485-4ae04d65ccfc tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468" status: 404 len: 111 microversion: 2.1 time: 0.033150 Apr 14 13:26:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 251/760] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:47 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:47 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:47 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:26:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7e53f078-16ea-4c6f-9f22-b4cdef777e2c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '.version_select at 0x7fa7438dd990>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7e53f078-16ea-4c6f-9f22-b4cdef777e2c tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578112597" status: 202 len: 0 microversion: 2.1 time: 0.027521 Apr 14 13:26:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 259/761] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 13:26:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578112597 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:26:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-34318e20-ab56-49d5-9853-cac2b99a7a6d tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.231498 Apr 14 13:26:48 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 252/762] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:26:47 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-interface => generated 282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:48 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1255991021", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "key_name": "tempest-TestStampPattern-924006334", "security_groups": [{"name": "tempest-secgroup-smoke-743531576"}], "networks": [{"uuid": "09bf32cb-4684-4c95-a44c-6924d228b6f0"}]}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] Creating event network-changed:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:26:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-afc8f025-08d7-4e95-98e2-78a04e7eff9b req-b1cb4562-0a16-4f19-be3c-af8104f12e86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034108 Apr 14 13:26:49 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 260/763] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.network.neutron [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] validate_networks() for [('09bf32cb-4684-4c95-a44c-6924d228b6f0', None, None, None, None, None)] {{(pid=61774) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:49 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lazy-loading 'services' on Instance uuid 775293fc-1773-407d-bf49-fccfe849f440 {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:26:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e846d374-6e4c-47d7-9246-90536fa6be1c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments/7f85a79b-307a-48e6-81fb-01b78bf092dc" status: 202 len: 0 microversion: 2.1 time: 0.193085 Apr 14 13:26:49 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 253/764] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:26:49 2023] DELETE /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments/7f85a79b-307a-48e6-81fb-01b78bf092dc => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2fca36d8-5a04-43b5-869e-7b333afa63ca tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053833 Apr 14 13:26:49 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 261/765] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:26:49 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting quotas for project fdd6e06c2dbf479697403fee2b1b72e2. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting quotas for user d53a298063a346ec9b41110051e689c8 and project fdd6e06c2dbf479697403fee2b1b72e2. Resources: {'instances', 'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Going to run 1 instances... {{(pid=61774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:26:49 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:26:50 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-bfacdf84-0efe-4a94-ac64-0e2ea6a0c05d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.060580 Apr 14 13:26:50 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 252/766] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:26:48 2023] POST /compute/v2.1/servers => generated 403 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:26:50 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c085de26-ea96-44d5-bd09-5494714cddd1 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:50 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c085de26-ea96-44d5-bd09-5494714cddd1 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:50 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-c085de26-ea96-44d5-bd09-5494714cddd1 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:50 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-c085de26-ea96-44d5-bd09-5494714cddd1 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3" status: 200 len: 1236 microversion: 2.1 time: 0.077571 Apr 14 13:26:50 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 254/767] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:50 2023] GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3 => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:26:51 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:51 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:51 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:51 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:51 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] Creating event network-changed:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:26:51 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-53e16d5c-6c13-417b-8eef-c648af7e1a59 req-ccdf53f7-2a77-4823-a0ae-8fb3229248ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050388 Apr 14 13:26:51 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 262/768] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:26:52 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 HTTP/1.1 Apr 14 13:26:52 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:26:52 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:26:52 user devstack@n-api.service[61774]: Connection: close Apr 14 13:26:52 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:26:52 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:26:52 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:26:52 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:26:52 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:52 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:52 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:52 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:26:52 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:26:52 user devstack@n-api.service[61774]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:26:52 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:52 user devstack@n-api.service[61774]: method: > Apr 14 13:26:52 user devstack@n-api.service[61774]: exception: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:52 user devstack@n-api.service[61774]: action_args: {'id': '01f10bee-45ba-4541-8af8-e392018ef468'} Apr 14 13:26:52 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:52 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-47cfc2a8-a230-4ed4-b8b3-b65eb4bb384b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468" status: 404 len: 111 microversion: 2.1 time: 0.036650 Apr 14 13:26:52 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 253/769] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:26:52 2023] DELETE /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:52 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:52 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 01f10bee-45ba-4541-8af8-e392018ef468] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:26:53 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 HTTP/1.1 Apr 14 13:26:53 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:26:53 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:26:53 user devstack@n-api.service[61775]: Connection: close Apr 14 13:26:53 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:26:53 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:26:53 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:26:53 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:26:53 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:53 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:53 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:53 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:26:53 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:26:53 user devstack@n-api.service[61775]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:26:53 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:53 user devstack@n-api.service[61775]: method: > Apr 14 13:26:53 user devstack@n-api.service[61775]: exception: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:53 user devstack@n-api.service[61775]: action_args: {'id': '01f10bee-45ba-4541-8af8-e392018ef468'} Apr 14 13:26:53 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. Apr 14 13:26:53 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance 01f10bee-45ba-4541-8af8-e392018ef468 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-fbb04070-8659-4b22-aa18-9e5f1cd11ba4 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468" status: 404 len: 111 microversion: 2.1 time: 0.031338 Apr 14 13:26:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 255/770] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:52 2023] GET /compute/v2.1/servers/01f10bee-45ba-4541-8af8-e392018ef468 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:53 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:26:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-984176a0-0c7c-4519-9610-6d76278b1cc1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24" status: 200 len: 1551 microversion: 2.1 time: 0.310622 Apr 14 13:26:53 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 263/771] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:53 2023] GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 => generated 1551 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:26:53 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31781f5a-460a-41e3-bdcf-9cb20f050ba3", "tag": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] Creating event network-changed:c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 on user Apr 14 13:26:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-6db92400-7830-4b76-833f-09132e9be3e7 req-82935c1f-35ea-42d4-8ec2-c92c0f6406ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037480 Apr 14 13:26:53 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 254/772] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:55 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31781f5a-460a-41e3-bdcf-9cb20f050ba3", "name": "network-vif-plugged", "status": "completed", "tag": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] Creating event network-vif-plugged:c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 on user Apr 14 13:26:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-aa38dd02-e04d-4f37-a408-b5882e9e1da9 req-44ea2058-ec76-4a29-ad22-322ab04052a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055583 Apr 14 13:26:55 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 256/773] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:26:56 user devstack@n-api.service[61776]: request: DELETE /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 HTTP/1.1 Apr 14 13:26:56 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:26:56 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:26:56 user devstack@n-api.service[61776]: Connection: close Apr 14 13:26:56 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:26:56 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:26:56 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:26:56 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:26:56 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:56 user devstack@n-api.service[61776]: method: > Apr 14 13:26:56 user devstack@n-api.service[61776]: exception: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: action_args: {'id': 'dca3424c-cbca-4520-a495-8867c2a9c0c4'} Apr 14 13:26:56 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2218b4aa-009c-4ceb-9d8b-7f4b394f8530 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4" status: 404 len: 111 microversion: 2.1 time: 0.048016 Apr 14 13:26:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 264/774] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:26:56 2023] DELETE /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: dca3424c-cbca-4520-a495-8867c2a9c0c4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:26:56 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 HTTP/1.1 Apr 14 13:26:56 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:26:56 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:26:56 user devstack@n-api.service[61774]: Connection: close Apr 14 13:26:56 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:26:56 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:26:56 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:26:56 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:26:56 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:56 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:56 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:26:56 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:26:56 user devstack@n-api.service[61774]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:26:56 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:56 user devstack@n-api.service[61774]: method: > Apr 14 13:26:56 user devstack@n-api.service[61774]: exception: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61774]: action_args: {'id': 'dca3424c-cbca-4520-a495-8867c2a9c0c4'} Apr 14 13:26:56 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance dca3424c-cbca-4520-a495-8867c2a9c0c4 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-8b27713c-2e3d-487f-82ee-5c6a2ea67312 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4" status: 404 len: 111 microversion: 2.1 time: 0.038120 Apr 14 13:26:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 255/775] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:56 2023] GET /compute/v2.1/servers/dca3424c-cbca-4520-a495-8867c2a9c0c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:26:56 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 HTTP/1.1 Apr 14 13:26:56 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:26:56 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:26:56 user devstack@n-api.service[61775]: Connection: close Apr 14 13:26:56 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:26:56 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:26:56 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:26:56 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:26:56 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:56 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:56 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:26:56 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:26:56 user devstack@n-api.service[61775]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:26:56 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:56 user devstack@n-api.service[61775]: method: > Apr 14 13:26:56 user devstack@n-api.service[61775]: exception: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61775]: action_args: {'id': '24179ea7-82e2-48fd-9aab-2e3bf7edb372'} Apr 14 13:26:56 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9face3e7-87fd-4593-9236-49df8ba8a45b tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372" status: 404 len: 111 microversion: 2.1 time: 0.033729 Apr 14 13:26:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 257/776] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:26:56 2023] DELETE /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: 24179ea7-82e2-48fd-9aab-2e3bf7edb372] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:26:56 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 HTTP/1.1 Apr 14 13:26:56 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:26:56 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:26:56 user devstack@n-api.service[61776]: Connection: close Apr 14 13:26:56 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:26:56 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:26:56 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:26:56 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:26:56 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:26:56 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:26:56 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:26:56 user devstack@n-api.service[61776]: method: > Apr 14 13:26:56 user devstack@n-api.service[61776]: exception: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: action_args: {'id': '24179ea7-82e2-48fd-9aab-2e3bf7edb372'} Apr 14 13:26:56 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. Apr 14 13:26:56 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:26:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance 24179ea7-82e2-48fd-9aab-2e3bf7edb372 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:26:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-44d1c449-5886-40a5-92f4-10807d693878 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372" status: 404 len: 111 microversion: 2.1 time: 0.029302 Apr 14 13:26:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 265/777] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:26:56 2023] GET /compute/v2.1/servers/24179ea7-82e2-48fd-9aab-2e3bf7edb372 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:26:57 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31781f5a-460a-41e3-bdcf-9cb20f050ba3", "name": "network-vif-plugged", "status": "completed", "tag": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:26:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:57 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] Creating event network-vif-plugged:c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 on user Apr 14 13:26:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-288a3075-981e-4e02-88d2-0a52a1d60481 req-e8a5faea-13bc-4826-bd35-43a2a29b35db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029439 Apr 14 13:26:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 256/778] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:26:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:26:58 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:58 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:58 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:59 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a417d0ab-975d-467e-8191-0cfd95277f89 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.243514 Apr 14 13:26:59 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 258/779] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 13:26:58 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/os-interface => generated 282 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:26:59 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:26:59 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:26:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:26:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:26:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:26:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:00 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:27:00 user devstack@n-api.service[61776]: request: DELETE /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 HTTP/1.1 Apr 14 13:27:00 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:27:00 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:27:00 user devstack@n-api.service[61776]: Connection: close Apr 14 13:27:00 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:27:00 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:27:00 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:27:00 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:27:00 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:27:00 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:27:00 user devstack@n-api.service[61776]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:27:00 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:27:00 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:27:00 user devstack@n-api.service[61776]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:27:00 user devstack@n-api.service[61776]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:27:00 user devstack@n-api.service[61776]: method: > Apr 14 13:27:00 user devstack@n-api.service[61776]: exception: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61776]: action_args: {'id': 'c34d24a3-a632-4f05-b6fb-dc3562dc93d6'} Apr 14 13:27:00 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:27:00 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-cdbf9d74-4e6e-4cf7-9053-a9603f6d6c3d tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6" status: 404 len: 111 microversion: 2.1 time: 0.348225 Apr 14 13:27:00 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 266/780] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:26:59 2023] DELETE /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => generated 111 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] [instance: c34d24a3-a632-4f05-b6fb-dc3562dc93d6] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] HTTP exception thrown: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Request method failure captured: Apr 14 13:27:00 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 HTTP/1.1 Apr 14 13:27:00 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:27:00 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:27:00 user devstack@n-api.service[61774]: Connection: close Apr 14 13:27:00 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:27:00 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:27:00 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:27:00 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:27:00 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVE4g7-znukXCHQRKrYg1SyLW7Zzap9tILURpNYxmetdLTIdgSWlkqHx2KYCLAIUVp1em7rqpwv43GWC38BYazpzX_Z6cTKqJc-SocDrh7e8uX1d8-m9YbdENl4VRvx9NRtW3sTwRnRJwqb1yuAgeDFQij9P33bjVZD3s_KhGNU9Xc8 Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Project-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6833a69217034c4d85ff10bf8aa2fa5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Tenant-Id: 6833a69217034c4d85ff10bf8aa2fa5c Apr 14 13:27:00 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-893959880 Apr 14 13:27:00 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:27:00 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:27:00 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:27:00 user devstack@n-api.service[61774]: X-User-Id: 65812c6559684eddbdde33cd64ca1fba Apr 14 13:27:00 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeNegativeTest-893959880-project-member Apr 14 13:27:00 user devstack@n-api.service[61774]: method: > Apr 14 13:27:00 user devstack@n-api.service[61774]: exception: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61774]: action_args: {'id': 'c34d24a3-a632-4f05-b6fb-dc3562dc93d6'} Apr 14 13:27:00 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. Apr 14 13:27:00 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] Returning 404 to user: Instance c34d24a3-a632-4f05-b6fb-dc3562dc93d6 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:27:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-223b3b7e-712c-4aa1-a89d-14feaba68db3 tempest-AttachVolumeNegativeTest-893959880 tempest-AttachVolumeNegativeTest-893959880-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6" status: 404 len: 111 microversion: 2.1 time: 0.048470 Apr 14 13:27:00 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 257/781] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:27:00 2023] GET /compute/v2.1/servers/c34d24a3-a632-4f05-b6fb-dc3562dc93d6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:27:00 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:00 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:00 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:00 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] Creating event network-changed:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:27:00 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-04fdd132-26c6-4532-8503-e3095f4172c7 req-4a5a6cab-6be5-4eab-a2eb-0af33c917540 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040017 Apr 14 13:27:00 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 259/782] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-d953cf42-7d80-44a5-b2e2-52fb46f3c5bc tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/ips" status: 200 len: 109 microversion: 2.20 time: 0.038274 Apr 14 13:27:00 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 258/783] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 13:27:00 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/ips => generated 109 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:27:01 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:01 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-cc741e11-1e17-47ff-b19b-fc9e4710d5da tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1730 microversion: 2.1 time: 0.591764 Apr 14 13:27:01 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 267/784] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:27:00 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1730 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:03 user devstack@n-api.service[61775]: DEBUG nova.objects.instance [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lazy-loading 'flavor' on Instance uuid f7df0d0b-535b-4a60-a050-ddd6449e3c4d {{(pid=61775) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:27:04 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a8f1cda5-07bc-46d4-930a-c8df4e67a5e0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/action" status: 202 len: 0 microversion: 2.20 time: 1.017541 Apr 14 13:27:04 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 260/785] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:27:03 2023] POST /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/action => generated 0 bytes in 1019 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:04 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:04 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-dac70098-4167-4ab2-91d4-725301a1097e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 200 len: 1711 microversion: 2.20 time: 0.259769 Apr 14 13:27:04 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 259/786] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:27:04 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 1711 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:27:04 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-unplugged", "status": "completed", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:04 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] Creating event network-vif-unplugged:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:27:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0396bad6-2cb4-40a7-ae8e-0270e4cd2435 req-56c3d87a-37a1-43d4-865b-987c639a691f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056212 Apr 14 13:27:04 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 268/787] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:06 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-plugged", "status": "completed", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:06 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:06 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] Creating event network-vif-plugged:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:27:06 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-ea6a4849-cf7c-4602-b9d7-031f328862fe req-25b6fb1c-90ec-4aa3-9c26-36ee42ef81da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033804 Apr 14 13:27:06 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 261/788] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-d8b688ac-5dbe-494f-85f1-8fccd1c06b91 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa743626f80>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-d8b688ac-5dbe-494f-85f1-8fccd1c06b91 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/63af269e-d4e2-4c70-a996-22176866fe55" status: 200 len: 351 microversion: 2.1 time: 0.058016 Apr 14 13:27:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 260/789] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:27:08 2023] GET /compute/v2.1/os-volumes/63af269e-d4e2-4c70-a996-22176866fe55 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:09 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:09 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:09 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] Creating event network-changed:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:27:09 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-5c933623-18fc-4a35-97fc-9c768553d3b8 req-59af83c2-233f-4a4c-abeb-0c460815e4db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034712 Apr 14 13:27:09 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 269/790] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:11 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1718678047"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:11 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:11 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9cdbdcb4-5f2b-4e51-8de7-1625a1ee4166 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa743625870>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9cdbdcb4-5f2b-4e51-8de7-1625a1ee4166 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d7c48b74-91da-45cd-af7f-f9216b153f35" status: 200 len: 351 microversion: 2.1 time: 0.057686 Apr 14 13:27:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 261/791] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:27:11 2023] GET /compute/v2.1/os-volumes/d7c48b74-91da-45cd-af7f-f9216b153f35 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:12 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-eb53e1ef-78b9-4ced-a224-6eceac632a7e tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1/action" status: 202 len: 52 microversion: 2.87 time: 0.879612 Apr 14 13:27:12 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 262/792] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:27:11 2023] POST /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1/action => generated 52 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 13:27:13 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9015abb2-15a3-4953-9e0f-4285ca0b183f tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa74381e4d0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9015abb2-15a3-4953-9e0f-4285ca0b183f tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1633ab85-e509-4b77-b353-e471a7a4ca13" status: 200 len: 351 microversion: 2.1 time: 0.057946 Apr 14 13:27:13 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 270/793] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:27:13 2023] GET /compute/v2.1/os-volumes/1633ab85-e509-4b77-b353-e471a7a4ca13 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-83f774c7-d7c9-48d5-b356-3c131c3dfd85 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa7438732e0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-83f774c7-d7c9-48d5-b356-3c131c3dfd85 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.124916 Apr 14 13:27:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 262/794] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 13:27:13 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a2d7ce67-ff43-4cf6-8513-7cd5647add66 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa7439a11b0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a2d7ce67-ff43-4cf6-8513-7cd5647add66 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.107191 Apr 14 13:27:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 263/795] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 13:27:14 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-64b56c5e-579d-427b-8ccc-4f4d396c2dc9 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa74381d900>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-64b56c5e-579d-427b-8ccc-4f4d396c2dc9 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088176 Apr 14 13:27:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 271/796] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 13:27:14 2023] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b4c4eb06-faef-4b8c-8288-ce09b9fef516 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa743624790>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b4c4eb06-faef-4b8c-8288-ce09b9fef516 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.082848 Apr 14 13:27:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 263/797] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 13:27:14 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-39ab31e2-73cb-4651-afbc-89823d8f27e3 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa7438aeb90>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-39ab31e2-73cb-4651-afbc-89823d8f27e3 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.090304 Apr 14 13:27:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 264/798] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 13:27:14 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-83027adc-cc8e-41a1-85ad-308d58dae570 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa74387dea0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-83027adc-cc8e-41a1-85ad-308d58dae570 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088605 Apr 14 13:27:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 272/799] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 13:27:14 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:14 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6341dc78-0eb7-4716-9355-a632c5650fb0 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa743873370>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6341dc78-0eb7-4716-9355-a632c5650fb0 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085162 Apr 14 13:27:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 264/800] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 13:27:14 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4b2d35c4-ecfd-4fd4-b35c-1642d65af452 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] Calling method '.version_select at 0x7fa743ba04c0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-4b2d35c4-ecfd-4fd4-b35c-1642d65af452 tempest-VolumesTestJSON-309041867 tempest-VolumesTestJSON-309041867-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.184487 Apr 14 13:27:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 265/801] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 13:27:14 2023] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:16 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:16 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:16 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:16 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-282acf1c-5a2e-4328-837d-e4dbe72fc77d tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.244011 Apr 14 13:27:16 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 273/802] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:27:16 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments => generated 25 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=24 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] HTTP exception thrown: Instance 49467859-954f-498d-b520-587c7f38effc is not attached to volume fcdfe359-4681-4ebf-847d-85edfd26edc0 Apr 14 13:27:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Request method failure captured: Apr 14 13:27:17 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments/fcdfe359-4681-4ebf-847d-85edfd26edc0 HTTP/1.1 Apr 14 13:27:17 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:27:17 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:27:17 user devstack@n-api.service[61774]: Connection: close Apr 14 13:27:17 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:27:17 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:27:17 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:27:17 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:27:17 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVOAgGMWtn6pNyHv4_KRUd7j3GPn9PujcZbzgfXnWPPatv8H7GPtp860X0CtLwVi07D8jcXDreIs4UXzg8Ab48WMgFNlOaZCzdtOYVNlcVS_O1aEE96ezBNFZlL4On-6BUxS8GaAGCydT918fgrDQojFHCnHy7wxEuz2K0g7fG_UpD8 Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Project-Id: 9ae2e95243bc4e19b093629197fbb173 Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Tenant: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Tenant-Id: 9ae2e95243bc4e19b093629197fbb173 Apr 14 13:27:17 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:27:17 user devstack@n-api.service[61774]: X-User: tempest-TestMinimumBasicScenario-929002235-project-member Apr 14 13:27:17 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:27:17 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:27:17 user devstack@n-api.service[61774]: X-User-Id: 9e1f366e5f9d43b9bbd8be316ddaa3a9 Apr 14 13:27:17 user devstack@n-api.service[61774]: X-User-Name: tempest-TestMinimumBasicScenario-929002235-project-member Apr 14 13:27:17 user devstack@n-api.service[61774]: method: > Apr 14 13:27:17 user devstack@n-api.service[61774]: exception: Instance 49467859-954f-498d-b520-587c7f38effc is not attached to volume fcdfe359-4681-4ebf-847d-85edfd26edc0 Apr 14 13:27:17 user devstack@n-api.service[61774]: action_args: {'server_id': '49467859-954f-498d-b520-587c7f38effc', 'id': 'fcdfe359-4681-4ebf-847d-85edfd26edc0'} Apr 14 13:27:17 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fcdfe359-4681-4ebf-847d-85edfd26edc0. Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49467859-954f-498d-b520-587c7f38effc is not attached to volume fcdfe359-4681-4ebf-847d-85edfd26edc0 Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49467859-954f-498d-b520-587c7f38effc is not attached to volume fcdfe359-4681-4ebf-847d-85edfd26edc0 Apr 14 13:27:17 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:27:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Returning 404 to user: Instance 49467859-954f-498d-b520-587c7f38effc is not attached to volume fcdfe359-4681-4ebf-847d-85edfd26edc0 {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:27:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-30e7f744-815d-49a4-80af-b7107bcba8c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments/fcdfe359-4681-4ebf-847d-85edfd26edc0" status: 404 len: 154 microversion: 2.1 time: 0.520205 Apr 14 13:27:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 265/803] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:27:16 2023] DELETE /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc/os-volume_attachments/fcdfe359-4681-4ebf-847d-85edfd26edc0 => generated 154 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:18 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-07016181-c303-4bee-947b-03ac8b6c3786 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1" status: 200 len: 1690 microversion: 2.87 time: 0.320038 Apr 14 13:27:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 266/804] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:27:18 2023] GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1 => generated 1690 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=39 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:22 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:27:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-73bd3cbd-d10b-4f1c-88f1-f3135d9c62ca tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 204 len: 0 microversion: 2.1 time: 0.172164 Apr 14 13:27:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 274/805] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:27:22 2023] DELETE /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-unplugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] Creating event network-vif-unplugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:27:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-d51a4a48-e973-4b09-a66a-3c0f594039b8 req-2052a5ce-2996-428a-a8a6-103c4529172a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032869 Apr 14 13:27:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 267/806] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:23 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:23 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-2f88d511-1e76-4dbe-91d5-6e19587daebe tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 200 len: 1542 microversion: 2.1 time: 0.281904 Apr 14 13:27:23 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 266/807] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:27:23 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 1542 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:27:24 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-deleted", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:24 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] Creating event network-vif-deleted:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:27:24 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-31c791ea-93dd-40bd-951a-c257500ca10b req-35dd4fe3-2dda-4767-a7d6-b0a20da98e9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035319 Apr 14 13:27:24 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 275/808] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:25 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49467859-954f-498d-b520-587c7f38effc", "name": "network-vif-plugged", "status": "completed", "tag": "bcff28e3-32d8-4f26-b087-4b1082f06cfb"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] Creating event network-vif-plugged:bcff28e3-32d8-4f26-b087-4b1082f06cfb for instance 49467859-954f-498d-b520-587c7f38effc on user Apr 14 13:27:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-915363bd-c0f6-4f58-a765-674a640ed697 req-46da1199-2f2f-46f9-b231-b4ff92d17ec7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028923 Apr 14 13:27:25 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 268/809] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=12 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-30341767-ec84-4e60-a59a-3012d2df8bd4 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047349 Apr 14 13:27:39 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 267/810] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:27:39 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:39 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:27:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-db05588d-702b-4a8b-b975-19554f151350 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 204 len: 0 microversion: 2.1 time: 0.134507 Apr 14 13:27:39 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 276/811] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:27:39 2023] DELETE /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=7 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=9 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:40 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-unplugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:40 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:40 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] Creating event network-vif-unplugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:27:40 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-93aca140-bb60-4027-828d-e070402aa387 req-0e1a3244-2c7c-4d90-b4e9-cab79663899a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036764 Apr 14 13:27:40 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 268/812] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:40 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-6f83effa-6433-4848-8dbc-519855339352 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 200 len: 1676 microversion: 2.1 time: 0.281897 Apr 14 13:27:40 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 269/813] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:27:39 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 1676 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:40 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9229489c-ecdb-4b55-8bed-62cde1c124b2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3" status: 200 len: 1537 microversion: 2.1 time: 0.261377 Apr 14 13:27:40 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 277/814] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:27:40 2023] GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:42 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-plugged", "status": "completed", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}, {"server_uuid": "775293fc-1773-407d-bf49-fccfe849f440", "name": "network-vif-deleted", "tag": "aef4cd67-4e33-4456-b7d9-195955db1cdc"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:42 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Creating event network-vif-plugged:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:27:42 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] Creating event network-vif-deleted:aef4cd67-4e33-4456-b7d9-195955db1cdc for instance 775293fc-1773-407d-bf49-fccfe849f440 on user Apr 14 13:27:42 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-3849451a-abe0-4746-9d01-be994a73c822 req-87ea9c49-0920-4f0f-954c-644913abaecb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040587 Apr 14 13:27:42 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 269/815] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:53 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b4794a89-85d5-4139-9c03-a57abb810a06 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24" status: 200 len: 1551 microversion: 2.1 time: 0.430978 Apr 14 13:27:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 270/816] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:27:53 2023] GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 => generated 1551 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:53 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:27:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2913bc86-4599-4414-886b-9970597869e9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24" status: 204 len: 0 microversion: 2.1 time: 0.133535 Apr 14 13:27:54 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 278/817] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:27:53 2023] DELETE /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=10 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:54 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-0e6847ef-cbb1-4384-a815-978a452ebddf tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24" status: 200 len: 1557 microversion: 2.1 time: 0.386142 Apr 14 13:27:54 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fbde75-cf77-4069-91ac-9d9c92c65c24", "name": "network-vif-unplugged", "status": "completed", "tag": "643e5d33-1456-403f-ba06-e25ec6713e7d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:54 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 270/818] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:27:54 2023] GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 => generated 1557 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:27:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:54 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] Creating event network-vif-unplugged:643e5d33-1456-403f-ba06-e25ec6713e7d for instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 on user Apr 14 13:27:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-9c9518f3-931a-40dd-b2d5-1a1ebb6fd4ce req-957308dc-9bbe-4912-a467-8f0d102bd397 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190210 Apr 14 13:27:54 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 271/819] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:55 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:55 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:55 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:27:55 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7b347eb2-ca68-4890-931a-ec1bf0e6013b tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 200 len: 1652 microversion: 2.20 time: 0.345124 Apr 14 13:27:55 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 279/820] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:27:54 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 1652 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:27:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-d49a7cdf-249c-4357-a8ea-9ea0198263a9 req-4d25cf21-2fea-4f8c-a0cd-165a4f39f12f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fbde75-cf77-4069-91ac-9d9c92c65c24", "name": "network-vif-deleted", "tag": "643e5d33-1456-403f-ba06-e25ec6713e7d"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d49a7cdf-249c-4357-a8ea-9ea0198263a9 req-4d25cf21-2fea-4f8c-a0cd-165a4f39f12f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d49a7cdf-249c-4357-a8ea-9ea0198263a9 req-4d25cf21-2fea-4f8c-a0cd-165a4f39f12f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d49a7cdf-249c-4357-a8ea-9ea0198263a9 req-4d25cf21-2fea-4f8c-a0cd-165a4f39f12f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d49a7cdf-249c-4357-a8ea-9ea0198263a9 req-4d25cf21-2fea-4f8c-a0cd-165a4f39f12f service nova] Creating event network-vif-deleted:643e5d33-1456-403f-ba06-e25ec6713e7d for instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 on user Apr 14 13:27:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-d49a7cdf-249c-4357-a8ea-9ea0198263a9 req-4d25cf21-2fea-4f8c-a0cd-165a4f39f12f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113538 Apr 14 13:27:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 271/821] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:27:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8fbde75-cf77-4069-91ac-9d9c92c65c24", "name": "network-vif-plugged", "status": "completed", "tag": "643e5d33-1456-403f-ba06-e25ec6713e7d"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:27:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:27:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:27:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:27:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] Creating event network-vif-plugged:643e5d33-1456-403f-ba06-e25ec6713e7d for instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 on user Apr 14 13:27:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-5a257b58-2cd3-4056-9695-d250ffc11218 req-30d256e9-8193-4592-ab33-544bb98c9ea6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033672 Apr 14 13:27:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 272/822] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:27:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:01 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:01 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:01 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2faf4971-41f3-4a9c-8992-15269beeb20f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/action" status: 202 len: 0 microversion: 2.1 time: 0.167040 Apr 14 13:28:01 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 280/823] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:28:01 2023] POST /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:28:01 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:01 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:01 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:01 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:01 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:01 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:01 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:01 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:02 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:02 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e31093f2-9b19-46ae-92ad-84f715678140 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1729 microversion: 2.1 time: 0.477182 Apr 14 13:28:02 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 272/824] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:01 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1729 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:28:03 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-unplugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:03 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Creating event network-vif-unplugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:28:03 user devstack@n-api.service[61775]: DEBUG nova.compute.api [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61775) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:28:03 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-6237fba6-c16d-4cab-8705-2b5b20c6da42 req-bb75b37c-6ac4-46d6-b003-557cab32b671 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053505 Apr 14 13:28:03 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 273/825] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}, {"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}, {"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}, {"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-unplugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:28:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:28:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:28:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Creating event network-vif-unplugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:28:05 user devstack@n-api.service[61776]: DEBUG nova.compute.api [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:28:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-c9f1beda-1ac0-4531-a6ab-3d6032d25277 req-28370f9e-c378-4557-a409-3368a39d515b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.044525 Apr 14 13:28:05 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 281/826] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:05 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:07 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:28:07 user devstack@n-api.service[61774]: DEBUG nova.compute.api [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61774) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:28:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-1860c068-e8f1-4215-a471-5fe8a6c815b2 req-ce19431e-5f91-43cf-b63d-bb4807df424f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044209 Apr 14 13:28:07 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 273/827] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 49467859-954f-498d-b520-587c7f38effc] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=8 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=14 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] HTTP exception thrown: Instance 49467859-954f-498d-b520-587c7f38effc could not be found. Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Request method failure captured: Apr 14 13:28:13 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc HTTP/1.1 Apr 14 13:28:13 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:28:13 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:28:13 user devstack@n-api.service[61775]: Connection: close Apr 14 13:28:13 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:28:13 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:28:13 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:28:13 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:28:13 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVOAgGMWtn6pNyHv4_KRUd7j3GPn9PujcZbzgfXnWPPatv8H7GPtp860X0CtLwVi07D8jcXDreIs4UXzg8Ab48WMgFNlOaZCzdtOYVNlcVS_O1aEE96ezBNFZlL4On-6BUxS8GaAGCydT918fgrDQojFHCnHy7wxEuz2K0g7fG_UpD8 Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Project-Id: 9ae2e95243bc4e19b093629197fbb173 Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Project-Name: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Tenant: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Tenant-Id: 9ae2e95243bc4e19b093629197fbb173 Apr 14 13:28:13 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:28:13 user devstack@n-api.service[61775]: X-User: tempest-TestMinimumBasicScenario-929002235-project-member Apr 14 13:28:13 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:28:13 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:28:13 user devstack@n-api.service[61775]: X-User-Id: 9e1f366e5f9d43b9bbd8be316ddaa3a9 Apr 14 13:28:13 user devstack@n-api.service[61775]: X-User-Name: tempest-TestMinimumBasicScenario-929002235-project-member Apr 14 13:28:13 user devstack@n-api.service[61775]: method: > Apr 14 13:28:13 user devstack@n-api.service[61775]: exception: Instance 49467859-954f-498d-b520-587c7f38effc could not be found. Apr 14 13:28:13 user devstack@n-api.service[61775]: action_args: {'id': '49467859-954f-498d-b520-587c7f38effc'} Apr 14 13:28:13 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49467859-954f-498d-b520-587c7f38effc could not be found. Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49467859-954f-498d-b520-587c7f38effc could not be found. Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49467859-954f-498d-b520-587c7f38effc could not be found. Apr 14 13:28:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Returning 404 to user: Instance 49467859-954f-498d-b520-587c7f38effc could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:28:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-5204fc59-f917-47a2-b68f-5a357c4b38c6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc" status: 404 len: 111 microversion: 2.1 time: 0.046379 Apr 14 13:28:13 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 274/828] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:13 2023] GET /compute/v2.1/servers/49467859-954f-498d-b520-587c7f38effc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:28:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4d096943-2f62-4e6a-974b-837d39925829 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '.version_select at 0x7fa7437bf400>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:13 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-4d096943-2f62-4e6a-974b-837d39925829 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1723696496" status: 202 len: 0 microversion: 2.1 time: 0.039070 Apr 14 13:28:13 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 274/829] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 13:28:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1723696496 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:28:13 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7677f13d-349a-42fa-a9ea-4fe59542171c tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Action: 'create', calling method: .version_select at 0x7fa74381f520>, body: {"keypair": {"name": "tempest-TestShelveInstance-1155531040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIS8eIL/I3kxODqxFDmjVZgbwaBnYYyEpymoIT8frdOJIbK3dXh9J9GGKAL9gBIvS+6clwDRwZVCayK/ppHQaSnk+tDF7XA0oMOuQgWly6j9ws3NqPQ/uDU7zZbqKPJbIA=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:13 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-7677f13d-349a-42fa-a9ea-4fe59542171c tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Getting quotas for project 6ba9f3b2ecb541aba4516734fdebd316. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:28:13 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-7677f13d-349a-42fa-a9ea-4fe59542171c tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Getting quotas for user 01b25b886ade4e6ea689010d655d99a0 and project 6ba9f3b2ecb541aba4516734fdebd316. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:28:13 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7677f13d-349a-42fa-a9ea-4fe59542171c tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.255189 Apr 14 13:28:13 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 282/830] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:28:13 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:28:14 user devstack@n-api.service[61775]: DEBUG nova.compute.api [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61775) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:28:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-3dbc77f6-a13e-4d98-be62-b22ad2cfb973 req-ba28f3d1-4f5a-4814-a2bc-09cea6a8ea37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059608 Apr 14 13:28:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 275/831] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-41c15e21-5d57-4b86-9e86-5d62ea25b444 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'create', calling method: .version_select at 0x7fa743832170>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1166797782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlGI9D4/7pv9vQ3CZXSBbrtbkDj0yyrDe0vnPovM9eQS+33AyfYa6U/m76AkDp7hpito5RK9q+cvN4dfCRtTK05lrs3oeIET8QKJZApVgXOoADHebmvp9epkF8YKFm31Q=="}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:16 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-41c15e21-5d57-4b86-9e86-5d62ea25b444 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting quotas for project 9ae2e95243bc4e19b093629197fbb173. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:28:16 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-41c15e21-5d57-4b86-9e86-5d62ea25b444 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting quotas for user 9e1f366e5f9d43b9bbd8be316ddaa3a9 and project 9ae2e95243bc4e19b093629197fbb173. Resources: {'key_pairs'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:28:16 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-41c15e21-5d57-4b86-9e86-5d62ea25b444 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060427 Apr 14 13:28:16 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 275/832] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:28:16 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:16 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:16 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1063896944", "imageRef": "8ce99b3b-1304-4e73-a97b-e88d2addf3cd", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1166797782", "networks": [{"uuid": "b9f90019-51fc-4e13-aa38-910e26bbb8d1"}]}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:16 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] validate_networks() for [('b9f90019-51fc-4e13-aa38-910e26bbb8d1', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:28:17 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:28:17 user devstack@n-api.service[61775]: DEBUG nova.compute.api [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] Instance 6e646c88-579e-4ea1-b987-da1c7194a064 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61775) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:28:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-407fb37c-2318-4f2f-bf1c-10b4f254642a req-00328ba2-d48b-488e-80d4-fcb0c10aee36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045254 Apr 14 13:28:17 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 276/833] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting quotas for project 9ae2e95243bc4e19b093629197fbb173. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Getting quotas for user 9e1f366e5f9d43b9bbd8be316ddaa3a9 and project 9ae2e95243bc4e19b093629197fbb173. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:28:17 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8ce99b3b-1304-4e73-a97b-e88d2addf3cd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:28:17 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-fb36db4c-1461-4bf5-97e8-a43b35bc0b02 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.024142 Apr 14 13:28:17 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 283/834] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:28:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:28:17 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=18 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-2366b9d9-339e-4116-8c89-f9cbb71c5d49 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:17 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-2366b9d9-339e-4116-8c89-f9cbb71c5d49 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:17 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-2366b9d9-339e-4116-8c89-f9cbb71c5d49 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-2366b9d9-339e-4116-8c89-f9cbb71c5d49 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1253 microversion: 2.1 time: 0.130475 Apr 14 13:28:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 276/835] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:17 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1253 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:28:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-548766851", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-1155531040", "security_groups": [{"name": "tempest-secgroup-smoke-1286697578"}], "networks": [{"uuid": "0a7d4ddd-e535-4d06-a605-a34d3ef8188c"}], "block_device_mapping_v2": [{"uuid": "2724b817-0ad1-4678-9429-3f4e67a0f590", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:19 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] validate_networks() for [('0a7d4ddd-e535-4d06-a605-a34d3ef8188c', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1217180291", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "destination_type": "volume"}], "networks": [{"uuid": "5bb34665-b8a7-4eb1-a250-c5b7ca33f499"}]}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] validate_networks() for [('5bb34665-b8a7-4eb1-a250-c5b7ca33f499', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting quotas for project a573d19b775642bba2f2883e0005492d. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Getting quotas for user ebc2d46bc1794568841df20b046356c7 and project a573d19b775642bba2f2883e0005492d. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:28:19 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:28:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4cb098e4-74ca-4793-bf1d-a1b83e63821f tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.000506 Apr 14 13:28:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 284/836] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 13:28:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 13:28:20 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b2d67908-c7a5-4890-96a2-cfa37121b1ff tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:20 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-b2d67908-c7a5-4890-96a2-cfa37121b1ff tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:20 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b2d67908-c7a5-4890-96a2-cfa37121b1ff tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:20 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b2d67908-c7a5-4890-96a2-cfa37121b1ff tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:20 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b2d67908-c7a5-4890-96a2-cfa37121b1ff tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b2d67908-c7a5-4890-96a2-cfa37121b1ff tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 200 len: 1395 microversion: 2.87 time: 0.168145 Apr 14 13:28:20 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 277/837] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:28:20 2023] GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 1395 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Getting quotas for project 6ba9f3b2ecb541aba4516734fdebd316. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Getting quotas for user 01b25b886ade4e6ea689010d655d99a0 and project 6ba9f3b2ecb541aba4516734fdebd316. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:28:20 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2724b817-0ad1-4678-9429-3f4e67a0f590',volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:28:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a5747c70-4a40-40ab-8d90-f5d1fe9f0cca tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.713176 Apr 14 13:28:20 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 277/838] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:28:18 2023] POST /compute/v2.1/servers => generated 404 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:28:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e39f1e94-fbd1-4eb3-8019-222c6056e817 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:20 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e39f1e94-fbd1-4eb3-8019-222c6056e817 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:20 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-e39f1e94-fbd1-4eb3-8019-222c6056e817 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e39f1e94-fbd1-4eb3-8019-222c6056e817 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 200 len: 1083 microversion: 2.1 time: 0.088434 Apr 14 13:28:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 285/839] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:20 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 1083 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:28:21 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:21 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:21 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] Creating event network-changed:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:28:21 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-e7e192af-b4a7-4f85-88f0-315ce872aabf req-c4a67105-e7a2-4661-a22f-22c3eadfed20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095130 Apr 14 13:28:21 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 278/840] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-plugged", "status": "completed", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] Creating event network-vif-plugged:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:28:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-d61f8bd4-2b19-477e-bb13-4c0273321b33 req-72b51866-e497-454a-bd63-39e45d1d1e0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Apr 14 13:28:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 278/841] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] Creating event network-changed:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:28:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-fa0de5bc-83fd-4dc6-8328-198b73ecb7f6 req-fa083149-6674-4df3-b9cd-cbf0c15ea041 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034765 Apr 14 13:28:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 286/842] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:25 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-plugged", "status": "completed", "tag": "40073711-7679-449b-8856-60989099101c"}, {"name": "network-changed", "server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:25 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Creating event network-vif-plugged:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:28:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] Creating event network-changed:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:28:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-fb38db24-1241-4033-9a2a-63585ab04b2e req-9caf897f-40e5-46c9-86d5-21d3fcae2c34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038725 Apr 14 13:28:25 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 279/843] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:25 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 775293fc-1773-407d-bf49-fccfe849f440] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] HTTP exception thrown: Instance 775293fc-1773-407d-bf49-fccfe849f440 could not be found. Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Request method failure captured: Apr 14 13:28:30 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 HTTP/1.1 Apr 14 13:28:30 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:28:30 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:28:30 user devstack@n-api.service[61775]: Connection: close Apr 14 13:28:30 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:28:30 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:28:30 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:28:30 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:28:30 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVE7CGJtJfygjQPSdMR9HSJ45TI47-gc7b_dYSZu4c6o-461OeFnWunYQdMelQeuQMoyYrT4x_8u-ku0jtC8aSfJi9VllPjdCnuGgerzPdVXG2IqpenQO2JJJpbhVia5ePLnIh7jnyHBoauudGF2BYrj_V1DNjXJ6YywwM3H7Bd_qAA Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Project-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Tenant-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:28:30 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:28:30 user devstack@n-api.service[61775]: X-User: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:28:30 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:28:30 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:28:30 user devstack@n-api.service[61775]: X-User-Id: 3948b7c643374bcdbeb34f0f2f790c3c Apr 14 13:28:30 user devstack@n-api.service[61775]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:28:30 user devstack@n-api.service[61775]: method: > Apr 14 13:28:30 user devstack@n-api.service[61775]: exception: Instance 775293fc-1773-407d-bf49-fccfe849f440 could not be found. Apr 14 13:28:30 user devstack@n-api.service[61775]: action_args: {'id': '775293fc-1773-407d-bf49-fccfe849f440'} Apr 14 13:28:30 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 775293fc-1773-407d-bf49-fccfe849f440 could not be found. Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 775293fc-1773-407d-bf49-fccfe849f440 could not be found. Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 775293fc-1773-407d-bf49-fccfe849f440 could not be found. Apr 14 13:28:30 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:28:30 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Returning 404 to user: Instance 775293fc-1773-407d-bf49-fccfe849f440 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:28:30 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-abb5c9e2-a5cc-48ae-b66a-b15c50505c9c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440" status: 404 len: 111 microversion: 2.1 time: 0.036778 Apr 14 13:28:30 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 279/844] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:30 2023] GET /compute/v2.1/servers/775293fc-1773-407d-bf49-fccfe849f440 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:28:30 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:30 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1aa60058-ed15-43e6-8354-57bd9a918404 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '.version_select at 0x7fa74381da20>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:30 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:30 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-1aa60058-ed15-43e6-8354-57bd9a918404 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544885661" status: 202 len: 0 microversion: 2.1 time: 0.025772 Apr 14 13:28:30 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 287/845] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 13:28:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544885661 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:28:31 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=8 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:31 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:31 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:31 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:28:31 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-d78a5456-c717-4609-aeb4-36ed557af209 req-5aa4c5af-d101-478d-a9d8-7d0d309f929c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292296 Apr 14 13:28:31 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 280/846] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:33 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:33 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:33 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:28:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-01c4f6d6-fd1b-4531-9a4f-5b3307fe7643 req-b3f29b06-5c5e-4405-822d-0feefdd83453 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 Apr 14 13:28:33 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 280/847] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:36 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=18 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:36 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:36 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:36 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:36 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:28:36 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-1d75973b-7ad3-43a3-8cdf-61a8ba291a76 req-16ade7b0-1531-4673-9600-8c3c9257afbe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056748 Apr 14 13:28:36 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 288/848] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:28:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-d097b14c-dab8-41a7-936d-9b4240073346 req-8b02502f-0a18-469f-a9bc-495487a96336 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039460 Apr 14 13:28:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 281/849] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:39 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:28:39 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3812487b-85e8-4e0a-9132-515292b0e11c tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f" status: 204 len: 0 microversion: 2.1 time: 0.146986 Apr 14 13:28:39 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 281/850] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:28:39 2023] DELETE /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:39 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7256a1aa-b3a2-48d9-8b65-742ca71f8671 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f" status: 200 len: 1495 microversion: 2.1 time: 0.263289 Apr 14 13:28:39 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 289/851] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:39 2023] GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f => generated 1495 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:28:39 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-unplugged", "status": "completed", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] Creating event network-vif-unplugged:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:28:39 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-4efaf3e9-de81-418a-bdb4-aa7a981a1c0e req-f4cfb197-64bf-4e34-91d8-262a22cc0e82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035446 Apr 14 13:28:39 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 282/852] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:40 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:40 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-b1117d01-1977-41ca-8a29-fa74de9b8e08 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3" status: 200 len: 1537 microversion: 2.1 time: 0.252502 Apr 14 13:28:40 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 282/853] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:40 2023] GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3 => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:28:41 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-a18977c1-caa2-413e-aa72-e858958f555a req-88b8f782-19cf-4a3d-8a95-1443f96a09ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-deleted", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-a18977c1-caa2-413e-aa72-e858958f555a req-88b8f782-19cf-4a3d-8a95-1443f96a09ae service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-a18977c1-caa2-413e-aa72-e858958f555a req-88b8f782-19cf-4a3d-8a95-1443f96a09ae service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:41 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-a18977c1-caa2-413e-aa72-e858958f555a req-88b8f782-19cf-4a3d-8a95-1443f96a09ae service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:41 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-a18977c1-caa2-413e-aa72-e858958f555a req-88b8f782-19cf-4a3d-8a95-1443f96a09ae service nova] Creating event network-vif-deleted:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:28:41 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-a18977c1-caa2-413e-aa72-e858958f555a req-88b8f782-19cf-4a3d-8a95-1443f96a09ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043911 Apr 14 13:28:41 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 290/854] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:41 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4631eb-ae5b-4efa-9def-c0c45f56f40f", "name": "network-vif-plugged", "status": "completed", "tag": "d5720602-747e-4fff-8334-2412fa184f73"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:41 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] Creating event network-vif-plugged:d5720602-747e-4fff-8334-2412fa184f73 for instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f on user Apr 14 13:28:41 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-453248e8-fc35-49b1-8916-78625d970651 req-dcc1bdbb-0a93-441c-a2a6-587e44b1f96d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042924 Apr 14 13:28:41 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 283/855] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57e0498e-3dd2-4931-b8e8-bc188948fa24"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:43 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:43 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31781f5a-460a-41e3-bdcf-9cb20f050ba3", "tag": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:43 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:43 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:43 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:43 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] Creating event network-changed:c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 on user Apr 14 13:28:43 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-ff8105a9-0f43-41e0-8604-dfd62ed09b1e req-9a7384f8-eaad-42b5-9564-01d85e994cdc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051161 Apr 14 13:28:43 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 291/856] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d58cb8ef-c352-48b4-8d41-9ea39b098b9e tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701676 Apr 14 13:28:44 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 283/857] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:28:43 2023] POST /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:28:44 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 HTTP/1.1 Apr 14 13:28:44 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:28:44 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:28:44 user devstack@n-api.service[61774]: Connection: close Apr 14 13:28:44 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:28:44 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:28:44 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:28:44 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:28:44 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:28:44 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:28:44 user devstack@n-api.service[61774]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:28:44 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:28:44 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:28:44 user devstack@n-api.service[61774]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:28:44 user devstack@n-api.service[61774]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:28:44 user devstack@n-api.service[61774]: method: > Apr 14 13:28:44 user devstack@n-api.service[61774]: exception: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:28:44 user devstack@n-api.service[61774]: action_args: {'id': 'b8fbde75-cf77-4069-91ac-9d9c92c65c24'} Apr 14 13:28:44 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:28:44 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:28:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:28:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-fdd3f438-2547-48ce-938e-19f59661f086 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24" status: 404 len: 111 microversion: 2.1 time: 0.044460 Apr 14 13:28:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 284/858] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:44 2023] GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:47 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:28:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-33bdd1f2-2cce-4093-ac33-ea6c71b22fd1 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3" status: 204 len: 0 microversion: 2.1 time: 0.122302 Apr 14 13:28:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 292/859] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:28:47 2023] DELETE /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:28:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:48 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d3b319-f069-48b6-bb53-32835bc6a2e3", "name": "network-vif-unplugged", "status": "completed", "tag": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:48 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-184377a3-ed5a-4462-9926-adc6a5a7c4e2 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3" status: 200 len: 1399 microversion: 2.1 time: 0.259082 Apr 14 13:28:48 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 284/860] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:47 2023] GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 => generated 1399 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:28:48 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=15 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:28:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] Creating event network-vif-unplugged:6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 on user Apr 14 13:28:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-da8a8e22-e258-4675-a0ca-57760b55d0f2 req-51384781-2d28-4bad-8538-2a37105667db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062167 Apr 14 13:28:48 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 285/861] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:49 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d3b319-f069-48b6-bb53-32835bc6a2e3", "name": "network-vif-deleted", "tag": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] Creating event network-vif-deleted:6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 on user Apr 14 13:28:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-9c987bf2-5466-4ee9-aa8b-5ca431433caa req-e67fc40f-34ba-459e-94fb-ab1359eea891 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Apr 14 13:28:49 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 293/862] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:50 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82d3b319-f069-48b6-bb53-32835bc6a2e3", "name": "network-vif-plugged", "status": "completed", "tag": "6f5b7a99-53da-4ad1-b18a-d4b62d359e1b"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:50 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] Creating event network-vif-plugged:6f5b7a99-53da-4ad1-b18a-d4b62d359e1b for instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 on user Apr 14 13:28:50 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-43f62700-6a44-45df-81e5-91b3f3d860a4 req-ebe6977d-93bc-4676-88ad-04e26a69f478 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028893 Apr 14 13:28:50 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 285/863] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:52 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7a4098f9-a3dc-490d-8f13-9d3a52190032 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1722 microversion: 2.1 time: 0.331973 Apr 14 13:28:52 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 286/864] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:28:52 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:53 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'services' on Instance uuid 31781f5a-460a-41e3-bdcf-9cb20f050ba3 {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:28:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-fe4e667d-be56-4dde-92f1-dbe9291023d7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments/57e0498e-3dd2-4931-b8e8-bc188948fa24" status: 202 len: 0 microversion: 2.1 time: 0.211990 Apr 14 13:28:53 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 294/865] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:28:53 2023] DELETE /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments/57e0498e-3dd2-4931-b8e8-bc188948fa24 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:28:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-dc9aa7c1-b49d-4013-a9cc-52be776878aa tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053857 Apr 14 13:28:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 286/866] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:28:53 2023] GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:28:55 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86242bf7-8ecc-4a0c-bfb4-82b3f6f684fd"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:55 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-3ae8c524-1ee3-43b5-865c-5b91437b56f1 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.513713 Apr 14 13:28:55 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 287/867] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 13:28:55 2023] POST /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/os-volume_attachments => generated 188 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:28:55 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:55 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:55 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:56 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-5904cad6-31dc-490d-baef-ca6bfa9080c8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/os-volume_attachments/86242bf7-8ecc-4a0c-bfb4-82b3f6f684fd" status: 202 len: 0 microversion: 2.20 time: 0.255927 Apr 14 13:28:56 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 295/868] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 13:28:55 2023] DELETE /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/os-volume_attachments/86242bf7-8ecc-4a0c-bfb4-82b3f6f684fd => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:56 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61775) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 13:28:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-dedcbfc8-33f7-4b7f-843f-6964ab22db9f tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/action" status: 202 len: 0 microversion: 2.20 time: 0.118251 Apr 14 13:28:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 287/869] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:28:56 2023] POST /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:56 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:28:56 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-297aa781-d299-4149-ab50-a7b00981730e tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 200 len: 1660 microversion: 2.20 time: 0.219589 Apr 14 13:28:56 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 288/870] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:28:56 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 1660 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:28:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:28:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:28:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:28:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:28:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] Creating event network-changed:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:28:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f999e96d-aa03-4be6-bc1c-0df0053c2c0d req-58973ee9-0a5b-4d8f-ba4b-534fb8c2a151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030207 Apr 14 13:28:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 296/871] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:28:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-plugged", "status": "completed", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] Creating event network-vif-plugged:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:29:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-97446fcf-67a6-4d7e-a93e-511d1f7c0ca0 req-d318dd78-a6f6-4f23-8afb-f2f341c00b73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033391 Apr 14 13:29:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 288/872] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:29:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 13:29:07 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-plugged", "status": "completed", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:07 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=19 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:07 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:07 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] Creating event network-vif-plugged:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:29:07 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-919e2183-7d0e-4ba6-b34e-2840cf721e84 req-cdd48b8e-af26-4982-b09b-49b3a094adc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035285 Apr 14 13:29:07 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 289/873] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:29:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:07 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:07 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c0916288-afac-43d4-a222-c270ab76349c tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1538 microversion: 2.1 time: 0.242817 Apr 14 13:29:07 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 297/874] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:07 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1538 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:10 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-41e57b15-4e2e-4a10-ab43-520158213a46 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 200 len: 1768 microversion: 2.87 time: 0.243015 Apr 14 13:29:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 289/875] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:29:10 2023] GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 1768 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:10 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:10 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-56813ff1-948c-4a80-8707-d471c9d9dfde tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 200 len: 1432 microversion: 2.1 time: 0.221231 Apr 14 13:29:10 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 290/876] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:10 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 1432 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=5 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: cc4631eb-ae5b-4efa-9def-c0c45f56f40f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] HTTP exception thrown: Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f could not be found. Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Request method failure captured: Apr 14 13:29:29 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f HTTP/1.1 Apr 14 13:29:29 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:29:29 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:29:29 user devstack@n-api.service[61776]: Connection: close Apr 14 13:29:29 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:29:29 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:29:29 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:29:29 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:29:29 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE7CGJtJfygjQPSdMR9HSJ45TI47-gc7b_dYSZu4c6o-461OeFnWunYQdMelQeuQMoyYrT4x_8u-ku0jtC8aSfJi9VllPjdCnuGgerzPdVXG2IqpenQO2JJJpbhVia5ePLnIh7jnyHBoauudGF2BYrj_V1DNjXJ6YywwM3H7Bd_qAA Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Project-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Tenant-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:29:29 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:29:29 user devstack@n-api.service[61776]: X-User: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:29:29 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:29:29 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:29:29 user devstack@n-api.service[61776]: X-User-Id: 3948b7c643374bcdbeb34f0f2f790c3c Apr 14 13:29:29 user devstack@n-api.service[61776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:29:29 user devstack@n-api.service[61776]: method: > Apr 14 13:29:29 user devstack@n-api.service[61776]: exception: Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f could not be found. Apr 14 13:29:29 user devstack@n-api.service[61776]: action_args: {'id': 'cc4631eb-ae5b-4efa-9def-c0c45f56f40f'} Apr 14 13:29:29 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f could not be found. Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f could not be found. Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f could not be found. Apr 14 13:29:29 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:29 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Returning 404 to user: Instance cc4631eb-ae5b-4efa-9def-c0c45f56f40f could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:29:29 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-76ce56f3-6d3b-4c20-92a5-453ed04b43b9 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f" status: 404 len: 111 microversion: 2.1 time: 0.137566 Apr 14 13:29:29 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 298/877] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:29 2023] GET /compute/v2.1/servers/cc4631eb-ae5b-4efa-9def-c0c45f56f40f => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:29 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:29:29 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-5fb400b5-3c49-4c3f-a921-611ba0561bd1 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 204 len: 0 microversion: 2.1 time: 0.119341 Apr 14 13:29:29 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 290/878] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:29:29 2023] DELETE /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=8 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:30 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-unplugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:30 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:30 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:30 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:30 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] Creating event network-vif-unplugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:29:30 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0f597f22-1dbc-4a32-96b7-db1cdd0d6ad4 req-db01ff27-c018-4174-a6b3-c39fcdf6a609 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027843 Apr 14 13:29:30 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 299/879] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:29:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:30 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3948b7c643374bcdbeb34f0f2f790c3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c8c8f620334166a141ea65525ba2a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:30 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-686b361d-7bf0-43a9-bcb0-eb5b25129d32 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 200 len: 1509 microversion: 2.1 time: 0.365788 Apr 14 13:29:30 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 291/880] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:29 2023] GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 1509 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:29:31 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-36c2ef7b-264f-4125-9eb7-8cd400967c5c req-236e59c4-6001-422c-aed9-a6f606125786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-deleted", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-36c2ef7b-264f-4125-9eb7-8cd400967c5c req-236e59c4-6001-422c-aed9-a6f606125786 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-36c2ef7b-264f-4125-9eb7-8cd400967c5c req-236e59c4-6001-422c-aed9-a6f606125786 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:31 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-36c2ef7b-264f-4125-9eb7-8cd400967c5c req-236e59c4-6001-422c-aed9-a6f606125786 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:31 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-36c2ef7b-264f-4125-9eb7-8cd400967c5c req-236e59c4-6001-422c-aed9-a6f606125786 service nova] Creating event network-vif-deleted:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:29:31 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-36c2ef7b-264f-4125-9eb7-8cd400967c5c req-236e59c4-6001-422c-aed9-a6f606125786 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035516 Apr 14 13:29:31 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 291/881] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:29:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:32 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29dc5faa-e15a-425c-80f8-ddb4f34f43d4", "name": "network-vif-plugged", "status": "completed", "tag": "f15f52ef-e473-4957-8be2-8c3ef6a9aa16"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:32 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] Creating event network-vif-plugged:f15f52ef-e473-4957-8be2-8c3ef6a9aa16 for instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 on user Apr 14 13:29:32 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-00b6ef70-f1af-4c15-bd86-88f1be3252be req-fd90b993-4f4e-4a1e-bc4c-a33a7cdbbc22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028238 Apr 14 13:29:32 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 300/882] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:29:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:29:38 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 HTTP/1.1 Apr 14 13:29:38 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:29:38 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:29:38 user devstack@n-api.service[61774]: Connection: close Apr 14 13:29:38 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:29:38 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:29:38 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:29:38 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:29:38 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61774]: method: > Apr 14 13:29:38 user devstack@n-api.service[61774]: exception: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: action_args: {'id': '82d3b319-f069-48b6-bb53-32835bc6a2e3'} Apr 14 13:29:38 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:29:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e240085e-6a21-4692-bab2-9df7bc1db88c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3" status: 404 len: 111 microversion: 2.1 time: 0.027227 Apr 14 13:29:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 292/883] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:38 2023] GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:29:38 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 HTTP/1.1 Apr 14 13:29:38 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:29:38 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:29:38 user devstack@n-api.service[61775]: Connection: close Apr 14 13:29:38 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:29:38 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:29:38 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:29:38 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:29:38 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61775]: method: > Apr 14 13:29:38 user devstack@n-api.service[61775]: exception: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: action_args: {'id': 'b8fbde75-cf77-4069-91ac-9d9c92c65c24'} Apr 14 13:29:38 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:29:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-4f119285-9292-4475-8196-28b2a0850149 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24" status: 404 len: 111 microversion: 2.1 time: 0.027226 Apr 14 13:29:38 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 292/884] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:29:38 2023] DELETE /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: b8fbde75-cf77-4069-91ac-9d9c92c65c24] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:29:38 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 HTTP/1.1 Apr 14 13:29:38 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:29:38 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:29:38 user devstack@n-api.service[61776]: Connection: close Apr 14 13:29:38 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:29:38 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:29:38 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:29:38 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:29:38 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61776]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61776]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:29:38 user devstack@n-api.service[61776]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61776]: method: > Apr 14 13:29:38 user devstack@n-api.service[61776]: exception: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61776]: action_args: {'id': 'b8fbde75-cf77-4069-91ac-9d9c92c65c24'} Apr 14 13:29:38 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance b8fbde75-cf77-4069-91ac-9d9c92c65c24 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:29:38 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-931396e3-0bf1-4011-9d95-28b601796b32 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24" status: 404 len: 111 microversion: 2.1 time: 0.028691 Apr 14 13:29:38 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 301/885] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:38 2023] GET /compute/v2.1/servers/b8fbde75-cf77-4069-91ac-9d9c92c65c24 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:29:38 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 HTTP/1.1 Apr 14 13:29:38 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:29:38 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:29:38 user devstack@n-api.service[61774]: Connection: close Apr 14 13:29:38 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:29:38 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:29:38 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:29:38 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:29:38 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:29:38 user devstack@n-api.service[61774]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61774]: method: > Apr 14 13:29:38 user devstack@n-api.service[61774]: exception: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: action_args: {'id': '82d3b319-f069-48b6-bb53-32835bc6a2e3'} Apr 14 13:29:38 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:29:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-16785f89-8688-4588-bb97-7316a869d877 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3" status: 404 len: 111 microversion: 2.1 time: 0.029727 Apr 14 13:29:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 293/886] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:29:38 2023] DELETE /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 82d3b319-f069-48b6-bb53-32835bc6a2e3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:29:38 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 HTTP/1.1 Apr 14 13:29:38 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:29:38 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:29:38 user devstack@n-api.service[61775]: Connection: close Apr 14 13:29:38 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:29:38 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:29:38 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:29:38 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:29:38 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:29:38 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:29:38 user devstack@n-api.service[61775]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:29:38 user devstack@n-api.service[61775]: method: > Apr 14 13:29:38 user devstack@n-api.service[61775]: exception: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: action_args: {'id': '82d3b319-f069-48b6-bb53-32835bc6a2e3'} Apr 14 13:29:38 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. Apr 14 13:29:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:29:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 82d3b319-f069-48b6-bb53-32835bc6a2e3 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:29:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-11db8078-0a7e-4d16-9e0f-60e9ee0cc74c tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3" status: 404 len: 111 microversion: 2.1 time: 0.033793 Apr 14 13:29:38 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 293/887] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:38 2023] GET /compute/v2.1/servers/82d3b319-f069-48b6-bb53-32835bc6a2e3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-a5215f4a-85c1-4db4-9df1-8170f7103db6 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Action: 'create', calling method: .version_select at 0x7fa74387cf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-212867192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn0p0IUuVWoQy0dGsU9Pfuky6ks2ZRYQtS2s2AMQUPgWS/ZFj3/9xG//6C/vHeESCtbDFovyBlscNk5g1knYdZi4/iSS7XffFRPqq5TMnScynxdTnC9z463yGcQBrDWEQ=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-a5215f4a-85c1-4db4-9df1-8170f7103db6 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:29:38 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-a5215f4a-85c1-4db4-9df1-8170f7103db6 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for user bb40413bd0c3490d97b997f69c930f72 and project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:29:38 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-a5215f4a-85c1-4db4-9df1-8170f7103db6 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.042132 Apr 14 13:29:38 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 302/888] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:29:38 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:43 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-bf94e3bf-1ac7-4aaa-aea7-4d50eb5c3a6d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043969 Apr 14 13:29:43 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 294/889] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:29:43 2023] GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:29:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1166522692", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-212867192", "security_groups": [{"name": "tempest-secgroup-smoke-2072975958"}], "block_device_mapping_v2": [{"uuid": "9056cb37-c575-40f0-9cc7-7cd88b944cd4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "32e04661-5709-44d8-b16f-bc45b62317fc"}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:43 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] validate_networks() for [('32e04661-5709-44d8-b16f-bc45b62317fc', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for user bb40413bd0c3490d97b997f69c930f72 and project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:29:44 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9056cb37-c575-40f0-9cc7-7cd88b944cd4',volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:29:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-cea6fb19-e1ce-4d19-afcc-b6c063ae728d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.883385 Apr 14 13:29:44 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 294/890] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:29:43 2023] POST /compute/v2.1/servers => generated 404 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:29:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-0ffb11d9-b201-4d13-bb6c-b5845bb41749 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:44 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-0ffb11d9-b201-4d13-bb6c-b5845bb41749 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:44 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-0ffb11d9-b201-4d13-bb6c-b5845bb41749 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-0ffb11d9-b201-4d13-bb6c-b5845bb41749 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d" status: 200 len: 1089 microversion: 2.1 time: 0.067400 Apr 14 13:29:44 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 303/891] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:44 2023] GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:29:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-74539980"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:47 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:47 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:47 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-affeb331-d2e9-45d8-b42f-95fb96b2fb47 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 200 len: 1705 microversion: 2.20 time: 0.488752 Apr 14 13:29:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 295/892] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:29:46 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 1705 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:29:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167e06f3-4a3d-418d-8aaa-4827c749258d", "tag": "94fca401-a6e6-49b4-bdf9-4419787e733e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] Creating event network-changed:94fca401-a6e6-49b4-bdf9-4419787e733e for instance 167e06f3-4a3d-418d-8aaa-4827c749258d on user Apr 14 13:29:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-6a9bb7f7-ed24-4a72-b86d-434abf4fee75 req-8a18509a-8201-4469-ab7f-f9323d590f61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053897 Apr 14 13:29:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 304/893] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:29:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-7c80b627-eb59-4638-a395-c1a058762c47 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/action" status: 202 len: 0 microversion: 2.1 time: 0.838939 Apr 14 13:29:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 295/894] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:29:46 2023] POST /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/action => generated 0 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:52 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:52 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-50b12e19-3646-4b69-85e0-36609b1c6084 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1722 microversion: 2.1 time: 0.221615 Apr 14 13:29:52 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 296/895] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:52 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:29:52 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:52 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:53 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-eb2721b7-2717-4123-9cee-c5196e749f0f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1722 microversion: 2.1 time: 0.386412 Apr 14 13:29:53 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 305/896] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:52 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:29:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167e06f3-4a3d-418d-8aaa-4827c749258d", "name": "network-vif-plugged", "status": "completed", "tag": "94fca401-a6e6-49b4-bdf9-4419787e733e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] Creating event network-vif-plugged:94fca401-a6e6-49b4-bdf9-4419787e733e for instance 167e06f3-4a3d-418d-8aaa-4827c749258d on user Apr 14 13:29:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-4c7b517c-48d4-4a03-8972-d618e595cdbb req-71a70338-97c7-4f01-ab0d-0f6eac1638d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039822 Apr 14 13:29:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 296/897] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:29:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:55 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167e06f3-4a3d-418d-8aaa-4827c749258d", "name": "network-vif-plugged", "status": "completed", "tag": "94fca401-a6e6-49b4-bdf9-4419787e733e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] Creating event network-vif-plugged:94fca401-a6e6-49b4-bdf9-4419787e733e for instance 167e06f3-4a3d-418d-8aaa-4827c749258d on user Apr 14 13:29:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-b2db9ebd-765b-4ebb-9936-2e07ad5132c8 req-51592656-eee0-42b8-b30f-4c9b4cc2e504 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030533 Apr 14 13:29:55 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 297/898] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:29:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:29:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-846458075", "imageRef": "fdaeaeaf-d612-4b58-80b5-8cf70c8002c5", "flavorRef": "42", "key_name": "tempest-TestStampPattern-924006334", "security_groups": [{"name": "tempest-secgroup-smoke-743531576"}], "networks": [{"uuid": "09bf32cb-4684-4c95-a44c-6924d228b6f0"}]}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:29:56 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:56 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] validate_networks() for [('09bf32cb-4684-4c95-a44c-6924d228b6f0', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting quotas for project fdd6e06c2dbf479697403fee2b1b72e2. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Getting quotas for user d53a298063a346ec9b41110051e689c8 and project fdd6e06c2dbf479697403fee2b1b72e2. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:29:57 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fdaeaeaf-d612-4b58-80b5-8cf70c8002c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:29:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4fd7d29a-c095-44ab-bf7b-b25143ffbc3c tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.848224 Apr 14 13:29:57 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 306/899] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:29:56 2023] POST /compute/v2.1/servers => generated 403 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:29:57 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:57 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:29:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-02ffedb6-5bbc-463f-a9f0-fe91b4c51478 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:29:57 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-02ffedb6-5bbc-463f-a9f0-fe91b4c51478 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:29:57 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-02ffedb6-5bbc-463f-a9f0-fe91b4c51478 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:29:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-02ffedb6-5bbc-463f-a9f0-fe91b4c51478 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f" status: 200 len: 1235 microversion: 2.1 time: 0.120300 Apr 14 13:29:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 297/900] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:29:57 2023] GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f => generated 1235 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:00 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0f7d33-ba0c-4111-857d-319c5788106f", "tag": "e5381c33-8ca2-44a1-92a9-adda19cd90a5"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:00 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=15 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:00 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:00 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=31 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] Creating event network-changed:e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f on user Apr 14 13:30:00 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-f59c795e-1e9b-48ff-8cbb-f025b61c17b4 req-0de5d9b8-cc7e-4d77-a24c-f477b4298c4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044822 Apr 14 13:30:00 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 298/901] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0f7d33-ba0c-4111-857d-319c5788106f", "name": "network-vif-plugged", "status": "completed", "tag": "e5381c33-8ca2-44a1-92a9-adda19cd90a5"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:03 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:03 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=19 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] Creating event network-vif-plugged:e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f on user Apr 14 13:30:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-8af6d3f9-b59f-404e-8a3d-a1b937a59ea7 req-ee9a702a-d20c-4d8b-8edf-53d77afe2d09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039463 Apr 14 13:30:03 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 307/902] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0f7d33-ba0c-4111-857d-319c5788106f", "name": "network-vif-plugged", "status": "completed", "tag": "e5381c33-8ca2-44a1-92a9-adda19cd90a5"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:05 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:05 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] Creating event network-vif-plugged:e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f on user Apr 14 13:30:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-1d0fcc2b-213b-4fed-b34d-f1702b0a4ef4 req-90e0ce5a-2c1c-45a8-aca2-245c40a3de98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077882 Apr 14 13:30:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 298/903] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:08 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-cf2ff3f1-63aa-4ddd-91ea-c30fae5d46e3 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1538 microversion: 2.1 time: 0.244557 Apr 14 13:30:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 299/904] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:08 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1538 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Searching by: {'deleted': False, 'project_id': '9ae2e95243bc4e19b093629197fbb173'} {{(pid=61776) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:08 user devstack@n-api.service[61776]: DEBUG nova.compute.multi_cell_list [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61776) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 13:30:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-49420a5b-c171-4eed-a271-48eaa585fd36 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.179114 Apr 14 13:30:08 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 308/905] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 13:30:08 2023] GET /compute/v2.1/servers => generated 341 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:08 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-5ec9b249-9cfa-4384-84de-9e7ea8f1cf2f tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1538 microversion: 2.1 time: 0.404325 Apr 14 13:30:08 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 299/906] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:08 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1538 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:10 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "990e1d18-2cad-416d-bea0-e76f85eb68ca"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:10 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:10 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lazy-loading 'flavor' on Instance uuid 626abaa0-3f53-42cc-978e-21f0a80232fa {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c876f0a2-77a9-4215-b250-3342b92a3219 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa/action" status: 200 len: 29 microversion: 2.87 time: 0.407796 Apr 14 13:30:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 300/907] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:30:10 2023] POST /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa/action => generated 29 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:11 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:11 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-22c14d57-31c1-490a-bbc5-d3d9f9ed8484 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 200 len: 1432 microversion: 2.1 time: 0.352249 Apr 14 13:30:11 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 309/908] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:11 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 1432 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:11 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:11 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:11 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-2c084385-f6fd-4734-94b7-f947b99ee9e3 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 200 len: 1774 microversion: 2.87 time: 0.407792 Apr 14 13:30:11 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 300/909] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:30:11 2023] GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 1774 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:30:11 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-4252ea70-3c87-46a8-87c4-e0f7a5e88ce5 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358726 Apr 14 13:30:11 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 301/910] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:30:11 2023] POST /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments => generated 194 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:12 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-unplugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] Creating event network-vif-unplugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:30:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-f092a2ca-7d48-46d0-8748-d11d6f4185f2 req-50624bc0-7e4f-412f-a077-a8caada6a381 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030623 Apr 14 13:30:12 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 310/911] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:14 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}, {"name": "network-changed", "server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:14 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:30:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] Creating event network-changed:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:30:14 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-f911b651-ce60-47ce-8751-acd6574f5de7 req-e4c7c181-65e1-4f33-95df-be08f6797cea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.033874 Apr 14 13:30:14 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 301/912] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:14 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:14 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lazy-loading 'flavor' on Instance uuid 04cf64b3-e51b-418f-94f6-7597c4cd74bb {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:30:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-084adc9a-f6db-42a0-b10c-cb94fda2e96e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "POST /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb/action" status: 202 len: 0 microversion: 2.1 time: 0.113857 Apr 14 13:30:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 302/913] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:30:14 2023] POST /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:14 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ef5e85ac-3702-421b-bc83-09011660a4eb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 200 len: 1438 microversion: 2.1 time: 0.182003 Apr 14 13:30:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 311/914] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:14 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 1438 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:15 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-unplugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:15 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] Creating event network-vif-unplugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:30:15 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-f9ec552e-eaa2-4d05-9284-ee8f949bb7e8 req-7f623da7-45ac-4096-ab76-f26c047a92f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038026 Apr 14 13:30:15 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 302/915] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:30:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-aaa57fc2-7196-43b5-bd9b-5b98049eafc7 req-88fba1bc-a474-47be-ac84-fd1acce012a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039451 Apr 14 13:30:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 303/916] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:17 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:17 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:30:17 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-33889b56-9e3c-4e08-9616-26a600e29bcb req-5483d33d-e202-4900-ae3f-ff66c7293e12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032865 Apr 14 13:30:17 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 312/917] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:19 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}, {"name": "network-changed", "server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:19 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:30:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] Creating event network-changed:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:30:19 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-b95f87ff-5579-427c-ad86-1243574393e1 req-2c12076a-f25b-4ae9-99f9-7baeeefa498b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059001 Apr 14 13:30:19 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 303/918] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:19 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:19 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:19 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:19 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:20 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9494675e-e824-450b-8b2b-19b595e3df0a tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1584 microversion: 2.1 time: 0.387192 Apr 14 13:30:20 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 304/919] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:19 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1584 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] [instance: 29dc5faa-e15a-425c-80f8-ddb4f34f43d4] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] HTTP exception thrown: Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 could not be found. Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Request method failure captured: Apr 14 13:30:20 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 HTTP/1.1 Apr 14 13:30:20 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:30:20 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:30:20 user devstack@n-api.service[61776]: Connection: close Apr 14 13:30:20 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:30:20 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:30:20 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:30:20 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:30:20 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVE7CGJtJfygjQPSdMR9HSJ45TI47-gc7b_dYSZu4c6o-461OeFnWunYQdMelQeuQMoyYrT4x_8u-ku0jtC8aSfJi9VllPjdCnuGgerzPdVXG2IqpenQO2JJJpbhVia5ePLnIh7jnyHBoauudGF2BYrj_V1DNjXJ6YywwM3H7Bd_qAA Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Project-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a7c8c8f620334166a141ea65525ba2a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Tenant-Id: a7c8c8f620334166a141ea65525ba2a0 Apr 14 13:30:20 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698214771 Apr 14 13:30:20 user devstack@n-api.service[61776]: X-User: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:30:20 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:30:20 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:30:20 user devstack@n-api.service[61776]: X-User-Id: 3948b7c643374bcdbeb34f0f2f790c3c Apr 14 13:30:20 user devstack@n-api.service[61776]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698214771-project-member Apr 14 13:30:20 user devstack@n-api.service[61776]: method: > Apr 14 13:30:20 user devstack@n-api.service[61776]: exception: Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 could not be found. Apr 14 13:30:20 user devstack@n-api.service[61776]: action_args: {'id': '29dc5faa-e15a-425c-80f8-ddb4f34f43d4'} Apr 14 13:30:20 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 could not be found. Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 could not be found. Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 could not be found. Apr 14 13:30:20 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:30:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] Returning 404 to user: Instance 29dc5faa-e15a-425c-80f8-ddb4f34f43d4 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:30:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-14f85500-f386-4d22-916f-427110a3ee44 tempest-ServerRescueNegativeTestJSON-1698214771 tempest-ServerRescueNegativeTestJSON-1698214771-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4" status: 404 len: 111 microversion: 2.1 time: 0.040975 Apr 14 13:30:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 313/920] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:20 2023] GET /compute/v2.1/servers/29dc5faa-e15a-425c-80f8-ddb4f34f43d4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:30:21 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:21 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] Creating event network-changed:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:30:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-8823844b-9c10-44bc-bb8a-47f42a471845 req-65e27a64-0330-4f42-80ab-cd8cb7b11478 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032835 Apr 14 13:30:21 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 304/921] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:24 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-841941355"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:24 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:24 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:24 user devstack@n-api.service[61774]: INFO nova.network.security_group_api [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Adding security group a89c5a84-9acf-49fc-85d8-8359914e58df to port 40073711-7679-449b-8856-60989099101c Apr 14 13:30:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-365d0c5d-f3f0-428b-a1d9-cd3d8aa51fc7 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/action" status: 202 len: 0 microversion: 2.1 time: 0.698403 Apr 14 13:30:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 305/922] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:30:24 2023] POST /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:30:24 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:24 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:24 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] Creating event network-changed:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:30:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-ddea4e82-5ec0-4e4f-9e59-2a0c97516b02 req-edcd1825-319c-4b1f-bf4a-100e3cc63960 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040121 Apr 14 13:30:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 305/923] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:25 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-02e83d66-4a47-4265-8141-f5bc11db87b0 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1748 microversion: 2.1 time: 0.252887 Apr 14 13:30:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 314/924] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:24 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1748 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:25 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:25 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-74458530-cd6c-4520-a24c-e8ec2e4164f8 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/action" status: 202 len: 0 microversion: 2.1 time: 0.088342 Apr 14 13:30:25 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 306/925] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:30:25 2023] POST /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:25 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-dcfae7f4-0638-4b43-aaf6-48893e346445 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1740 microversion: 2.1 time: 0.267483 Apr 14 13:30:25 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 306/926] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:25 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:28 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-unplugged", "status": "completed", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:28 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] Creating event network-vif-unplugged:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:30:28 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-7759119f-2d1a-4300-a72d-b1b4ec8d7750 req-e2ab22dd-d403-494f-8874-42b1919d60b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037602 Apr 14 13:30:28 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 315/927] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:30 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-plugged", "status": "completed", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:30 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=18 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:30 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:30 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] Creating event network-vif-plugged:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:30:30 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-f4523ed5-6f7f-4b35-bae0-e80390f246d9 req-c37a8757-fa0a-428b-bbca-3f006030b525 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078033 Apr 14 13:30:30 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 307/928] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:33 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-plugged", "status": "completed", "tag": "40073711-7679-449b-8856-60989099101c"}, {"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-plugged", "status": "completed", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:33 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Creating event network-vif-plugged:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:30:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] Creating event network-vif-plugged:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:30:33 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-61c5cde1-4182-4c0e-aadd-08240d0bdb29 req-44f2f1fa-eff4-431f-b444-f9c26899efa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030980 Apr 14 13:30:33 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 307/929] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:34 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:34 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:35 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:35 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c3f56a59-9c90-4b0e-8f6b-ffee3d948a5e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d" status: 200 len: 1442 microversion: 2.1 time: 0.311467 Apr 14 13:30:35 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 316/930] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:34 2023] GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d => generated 1442 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-69b5a840-a6cd-4a54-a4cb-4ddd6440ace0 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049792 Apr 14 13:30:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 308/931] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 13:30:47 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=21 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=32 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:30:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-dd74fe59-9201-40c0-8cdc-96e2f881fec3 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 204 len: 0 microversion: 2.20 time: 0.134012 Apr 14 13:30:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 308/932] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:30:47 2023] DELETE /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=19 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=41 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:47 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-1129c2d5-3d94-46ee-acfb-1b9b7c62246d tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f" status: 200 len: 1536 microversion: 2.1 time: 0.238990 Apr 14 13:30:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 309/933] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:47 2023] GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f => generated 1536 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-unplugged", "status": "completed", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:48 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:48 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:48 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f04370605aec40a0a53a080c1e8bf8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0fee50983a4e31b1689dc77b1c4db1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:48 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-3083da84-8335-4ef9-8c3b-73232fa52dd8 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 200 len: 1711 microversion: 2.20 time: 0.394471 Apr 14 13:30:48 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 317/934] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:30:47 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 1711 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:30:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:48 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] Creating event network-vif-unplugged:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:30:48 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-fb43658a-e1cd-4bfe-bbed-32274dbe90f5 req-837ce780-fd67-4ff9-b4cc-190df03beb34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084321 Apr 14 13:30:48 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 309/935] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-deleted", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] Creating event network-vif-deleted:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:30:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-34b9919e-96fd-4fc1-8d74-f388d3e9973a req-37ccb4e7-074e-476d-8340-16ae108dc344 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030644 Apr 14 13:30:49 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 310/936] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:50 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7df0d0b-535b-4a60-a050-ddd6449e3c4d", "name": "network-vif-plugged", "status": "completed", "tag": "3cf56142-3eb9-481f-9e81-b839a2106ab3"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] Creating event network-vif-plugged:3cf56142-3eb9-481f-9e81-b839a2106ab3 for instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d on user Apr 14 13:30:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-c32286aa-b15a-4a2a-b02c-42be56251f79 req-5b6d5ec8-79d7-49e0-9eed-7ecf160c5308 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037531 Apr 14 13:30:50 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 318/937] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:30:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-208a617c-d09c-4f5d-b9e6-2b27bce238c0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 204 len: 0 microversion: 2.1 time: 0.132655 Apr 14 13:30:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 310/938] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:30:53 2023] DELETE /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:53 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:30:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-30228587-30bb-40c3-9be2-0e3bbf6939b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 200 len: 1728 microversion: 2.1 time: 0.245832 Apr 14 13:30:53 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 311/939] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:30:53 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:30:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-unplugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] Creating event network-vif-unplugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:30:53 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-4933f9aa-49c4-4a7c-95b7-8d0d05437403 req-a07d58bb-ed15-413c-95e5-cd4cf0206965 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031011 Apr 14 13:30:53 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 319/940] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:55 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-613c411e-99cb-4512-9a7a-3624d7b950b6 req-bbaccf45-0ad0-44aa-b334-d8874f20b2f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-deleted", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-613c411e-99cb-4512-9a7a-3624d7b950b6 req-bbaccf45-0ad0-44aa-b334-d8874f20b2f2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-613c411e-99cb-4512-9a7a-3624d7b950b6 req-bbaccf45-0ad0-44aa-b334-d8874f20b2f2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-613c411e-99cb-4512-9a7a-3624d7b950b6 req-bbaccf45-0ad0-44aa-b334-d8874f20b2f2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-613c411e-99cb-4512-9a7a-3624d7b950b6 req-bbaccf45-0ad0-44aa-b334-d8874f20b2f2 service nova] Creating event network-vif-deleted:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:30:55 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-613c411e-99cb-4512-9a7a-3624d7b950b6 req-bbaccf45-0ad0-44aa-b334-d8874f20b2f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035752 Apr 14 13:30:55 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 311/941] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:30:55 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e646c88-579e-4ea1-b987-da1c7194a064", "name": "network-vif-plugged", "status": "completed", "tag": "25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:30:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:30:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:30:55 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:30:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] Creating event network-vif-plugged:25b21f1a-fbe3-4d4e-b6bb-fe12546e3ae7 for instance 6e646c88-579e-4ea1-b987-da1c7194a064 on user Apr 14 13:30:55 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-c92593c8-fe46-4a68-9e0e-f41367a0cc73 req-9dac6c5c-0fb0-491f-89df-47c0edc325cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032361 Apr 14 13:30:55 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 312/942] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:30:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:01 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:01 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:01 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:02 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:02 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:02 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:02 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-6566899f-5557-404a-9d96-7ba535fda9c4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 200 len: 1754 microversion: 2.87 time: 0.264392 Apr 14 13:31:02 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 320/943] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:31:01 2023] GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 1754 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:31:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:04 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:05 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-8fa312f9-8153-41cd-a96b-dcb5bb787d2e tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 200 len: 1498 microversion: 2.1 time: 0.242843 Apr 14 13:31:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 312/944] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:04 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 1498 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=10 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=22 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:15 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:15 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-48ae6ba6-318b-42d5-8aac-17f6c25911af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1748 microversion: 2.1 time: 0.366011 Apr 14 13:31:16 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 313/945] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:15 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1748 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:31:20 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=16 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:20 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=10 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:20 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-571d6767-cfdb-44f6-95af-73fcb3b421ee tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Action: 'create', calling method: .version_select at 0x7fa743a01ab0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-495571124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSR12YULXM8FktIsw6D48vtD0MlDPkVgXWEj6z/53NfD2oP5/RwVMdTTqlNjMV3Dhgc2epCdqJMfyWAUa9Jl7/2VBBQxV/ej5ckBQg3W9NS3eh/ghhBOuxl3PShD/C2bw=="}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:20 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-571d6767-cfdb-44f6-95af-73fcb3b421ee tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting quotas for project 0ad49f75bbe9461b936963e8dc6c8be5. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:31:20 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-571d6767-cfdb-44f6-95af-73fcb3b421ee tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting quotas for user 140e52ed81ba492abc14653240501497 and project 0ad49f75bbe9461b936963e8dc6c8be5. Resources: {'key_pairs'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:31:20 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-571d6767-cfdb-44f6-95af-73fcb3b421ee tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.260697 Apr 14 13:31:20 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 321/946] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 13:31:20 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:21 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-974413752", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-495571124", "security_groups": [{"name": "tempest-secgroup-smoke-833039758"}], "networks": [{"uuid": "a9168d79-fcda-4f76-82db-8993f13bbff3"}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] validate_networks() for [('a9168d79-fcda-4f76-82db-8993f13bbff3', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting quotas for project 0ad49f75bbe9461b936963e8dc6c8be5. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Getting quotas for user 140e52ed81ba492abc14653240501497 and project 0ad49f75bbe9461b936963e8dc6c8be5. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:31:22 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:31:22 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-07cb2b21-d3be-47d6-95ca-9611e76416e0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.646394 Apr 14 13:31:22 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 313/947] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:31:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:31:22 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6fd2e981-3da4-4aa4-949e-ff478e84004f tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:22 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-6fd2e981-3da4-4aa4-949e-ff478e84004f tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:22 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-6fd2e981-3da4-4aa4-949e-ff478e84004f tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140e52ed81ba492abc14653240501497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad49f75bbe9461b936963e8dc6c8be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:22 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6fd2e981-3da4-4aa4-949e-ff478e84004f tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a" status: 200 len: 1255 microversion: 2.1 time: 0.067118 Apr 14 13:31:22 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 314/948] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:22 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a => generated 1255 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:31:25 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b76423-23ff-4721-8300-b198286c109a", "tag": "5670a4df-018a-4b12-bf37-a1fada7bfe9e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] Creating event network-changed:5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance 03b76423-23ff-4721-8300-b198286c109a on user Apr 14 13:31:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0f0d3f6b-efb4-40d9-86ee-9ba313dfb82c req-259ee0e6-617d-4265-8c7a-e306e8dcec90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071185 Apr 14 13:31:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 322/949] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:27 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b76423-23ff-4721-8300-b198286c109a", "name": "network-vif-plugged", "status": "completed", "tag": "5670a4df-018a-4b12-bf37-a1fada7bfe9e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:27 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] Creating event network-vif-plugged:5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance 03b76423-23ff-4721-8300-b198286c109a on user Apr 14 13:31:27 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-98d1cb5d-7488-4689-adb3-532d58f90abe req-64c2ed81-5691-4f27-83d0-bbe16aca0909 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031118 Apr 14 13:31:27 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 314/950] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:29 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b76423-23ff-4721-8300-b198286c109a", "name": "network-vif-plugged", "status": "completed", "tag": "5670a4df-018a-4b12-bf37-a1fada7bfe9e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:29 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:29 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] Creating event network-vif-plugged:5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance 03b76423-23ff-4721-8300-b198286c109a on user Apr 14 13:31:29 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-51ecdea3-861c-4dff-9dae-84288cff8a4a req-d73bc9ab-3289-4999-8513-6ff92dd9ae0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075407 Apr 14 13:31:29 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 315/951] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:36 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:36 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-956df37b-87c7-4a28-ac53-80c847439f3e tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d" status: 200 len: 1442 microversion: 2.1 time: 1.406880 Apr 14 13:31:36 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 323/952] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:35 2023] GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d => generated 1442 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=4 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] HTTP exception thrown: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Request method failure captured: Apr 14 13:31:38 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d HTTP/1.1 Apr 14 13:31:38 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:31:38 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:31:38 user devstack@n-api.service[61775]: Connection: close Apr 14 13:31:38 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:31:38 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:31:38 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:31:38 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:31:38 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVJ0L00ckejtJxU6XxKcFnn6_fUq6MVy8jUhoW5zU-iCCo5FfT7SVU1imrpzzLyLqVWhKrdZL2FUUV0wSSXiXfypWSHk8TAApNW7f0JUebvLMSuDHVG4auQs3vsgbBNDjz2C4AuNKDVoIxbeRA4BtsERYW4_CPmZUYS_MZeKXxFHvfw Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Project-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Tenant-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:38 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:38 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:38 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:31:38 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:31:38 user devstack@n-api.service[61775]: X-User-Id: f04370605aec40a0a53a080c1e8bf8a8 Apr 14 13:31:38 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:38 user devstack@n-api.service[61775]: method: > Apr 14 13:31:38 user devstack@n-api.service[61775]: exception: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:38 user devstack@n-api.service[61775]: action_args: {'id': 'f7df0d0b-535b-4a60-a050-ddd6449e3c4d'} Apr 14 13:31:38 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:38 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:38 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Returning 404 to user: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:31:38 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e1e3d62d-a883-4f2a-8917-5e715fe7535c tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 404 len: 111 microversion: 2.20 time: 0.038695 Apr 14 13:31:38 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 315/953] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:31:38 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:31:38 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-818f2c54-92b7-49da-abc9-6a9bfca30d91 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '.version_select at 0x7fa743872c20>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-818f2c54-92b7-49da-abc9-6a9bfca30d91 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-321023180" status: 204 len: 0 microversion: 2.20 time: 0.058227 Apr 14 13:31:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 316/954] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 13:31:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-321023180 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:31:39 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "167e06f3-4a3d-418d-8aaa-4827c749258d", "tag": "94fca401-a6e6-49b4-bdf9-4419787e733e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] Creating event network-changed:94fca401-a6e6-49b4-bdf9-4419787e733e for instance 167e06f3-4a3d-418d-8aaa-4827c749258d on user Apr 14 13:31:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-144d945c-3c0e-4f33-bd82-961cc62cbcbb req-a228f138-0810-4665-9f2d-026d83c03c95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058359 Apr 14 13:31:39 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 324/955] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:39 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:31:39 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-30239cdd-fb1a-4e2a-98f9-ae984d398fa9 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d" status: 204 len: 0 microversion: 2.1 time: 0.107591 Apr 14 13:31:39 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 316/956] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:31:39 2023] DELETE /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:39 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:40 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:40 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-416da1a3-0ae7-42b6-896a-db5789b3205d tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d" status: 200 len: 1448 microversion: 2.1 time: 0.639020 Apr 14 13:31:40 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 317/957] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:39 2023] GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d => generated 1448 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 13:31:40 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167e06f3-4a3d-418d-8aaa-4827c749258d", "name": "network-vif-unplugged", "status": "completed", "tag": "94fca401-a6e6-49b4-bdf9-4419787e733e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:40 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] Creating event network-vif-unplugged:94fca401-a6e6-49b4-bdf9-4419787e733e for instance 167e06f3-4a3d-418d-8aaa-4827c749258d on user Apr 14 13:31:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-ff152872-96a0-4750-8c51-aad3e039dbbf req-b94b5982-c9e4-4966-bd27-f8136e995da3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034230 Apr 14 13:31:40 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 325/958] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] HTTP exception thrown: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Request method failure captured: Apr 14 13:31:42 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d HTTP/1.1 Apr 14 13:31:42 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:31:42 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:31:42 user devstack@n-api.service[61775]: Connection: close Apr 14 13:31:42 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:31:42 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:31:42 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:31:42 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:31:42 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVJ0L00ckejtJxU6XxKcFnn6_fUq6MVy8jUhoW5zU-iCCo5FfT7SVU1imrpzzLyLqVWhKrdZL2FUUV0wSSXiXfypWSHk8TAApNW7f0JUebvLMSuDHVG4auQs3vsgbBNDjz2C4AuNKDVoIxbeRA4BtsERYW4_CPmZUYS_MZeKXxFHvfw Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Project-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Tenant-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:42 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:42 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:42 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:31:42 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:31:42 user devstack@n-api.service[61775]: X-User-Id: f04370605aec40a0a53a080c1e8bf8a8 Apr 14 13:31:42 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:42 user devstack@n-api.service[61775]: method: > Apr 14 13:31:42 user devstack@n-api.service[61775]: exception: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61775]: action_args: {'id': 'f7df0d0b-535b-4a60-a050-ddd6449e3c4d'} Apr 14 13:31:42 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Returning 404 to user: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:31:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-803700b9-8f83-402d-b36e-8be65eb053d9 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 404 len: 111 microversion: 2.20 time: 0.063109 Apr 14 13:31:42 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 317/959] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:31:42 2023] DELETE /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: f7df0d0b-535b-4a60-a050-ddd6449e3c4d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:42 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] HTTP exception thrown: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Request method failure captured: Apr 14 13:31:42 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d HTTP/1.1 Apr 14 13:31:42 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:31:42 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:31:42 user devstack@n-api.service[61774]: Connection: close Apr 14 13:31:42 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:31:42 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:31:42 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:31:42 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:31:42 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVJ0L00ckejtJxU6XxKcFnn6_fUq6MVy8jUhoW5zU-iCCo5FfT7SVU1imrpzzLyLqVWhKrdZL2FUUV0wSSXiXfypWSHk8TAApNW7f0JUebvLMSuDHVG4auQs3vsgbBNDjz2C4AuNKDVoIxbeRA4BtsERYW4_CPmZUYS_MZeKXxFHvfw Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Project-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Tenant-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:42 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:42 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:42 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:31:42 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:31:42 user devstack@n-api.service[61774]: X-User-Id: f04370605aec40a0a53a080c1e8bf8a8 Apr 14 13:31:42 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:42 user devstack@n-api.service[61774]: method: > Apr 14 13:31:42 user devstack@n-api.service[61774]: exception: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61774]: action_args: {'id': 'f7df0d0b-535b-4a60-a050-ddd6449e3c4d'} Apr 14 13:31:42 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. Apr 14 13:31:42 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:42 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Returning 404 to user: Instance f7df0d0b-535b-4a60-a050-ddd6449e3c4d could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:31:42 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-85d398c9-2878-4b3b-92b9-6cea14fea7fd tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d" status: 404 len: 111 microversion: 2.20 time: 0.032323 Apr 14 13:31:42 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 318/960] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:31:42 2023] GET /compute/v2.1/servers/f7df0d0b-535b-4a60-a050-ddd6449e3c4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:31:42 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167e06f3-4a3d-418d-8aaa-4827c749258d", "name": "network-vif-plugged", "status": "completed", "tag": "94fca401-a6e6-49b4-bdf9-4419787e733e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:42 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] Creating event network-vif-plugged:94fca401-a6e6-49b4-bdf9-4419787e733e for instance 167e06f3-4a3d-418d-8aaa-4827c749258d on user Apr 14 13:31:42 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-eb04a153-0157-458e-a3d0-ef6821065419 req-d3fb1ac1-9bbc-4046-acb1-5b8a02cd59df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037392 Apr 14 13:31:42 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 326/961] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:31:43 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 HTTP/1.1 Apr 14 13:31:43 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:31:43 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:31:43 user devstack@n-api.service[61775]: Connection: close Apr 14 13:31:43 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:31:43 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:31:43 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:31:43 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:31:43 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:31:43 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:43 user devstack@n-api.service[61775]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:31:43 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:31:43 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:31:43 user devstack@n-api.service[61775]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:31:43 user devstack@n-api.service[61775]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:31:43 user devstack@n-api.service[61775]: method: > Apr 14 13:31:43 user devstack@n-api.service[61775]: exception: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61775]: action_args: {'id': '6e646c88-579e-4ea1-b987-da1c7194a064'} Apr 14 13:31:43 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:31:43 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0366fdd0-b4dd-41b9-a70e-342457970fb1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 404 len: 111 microversion: 2.1 time: 0.033073 Apr 14 13:31:43 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 318/962] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:43 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:31:43 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments HTTP/1.1 Apr 14 13:31:43 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:31:43 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:31:43 user devstack@n-api.service[61774]: Connection: close Apr 14 13:31:43 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:31:43 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:31:43 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:31:43 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:31:43 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:31:43 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:43 user devstack@n-api.service[61774]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:31:43 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:31:43 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:31:43 user devstack@n-api.service[61774]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:31:43 user devstack@n-api.service[61774]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:31:43 user devstack@n-api.service[61774]: method: > Apr 14 13:31:43 user devstack@n-api.service[61774]: exception: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61774]: action_args: {'server_id': '6e646c88-579e-4ea1-b987-da1c7194a064'} Apr 14 13:31:43 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:43 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:31:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-8b450336-2cca-4679-a18e-ef868dba6c69 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036370 Apr 14 13:31:43 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 319/963] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:31:43 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:31:44 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 HTTP/1.1 Apr 14 13:31:44 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:31:44 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:31:44 user devstack@n-api.service[61776]: Connection: close Apr 14 13:31:44 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:31:44 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:31:44 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:31:44 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:31:44 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:31:44 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:31:44 user devstack@n-api.service[61776]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:31:44 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:31:44 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:31:44 user devstack@n-api.service[61776]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:31:44 user devstack@n-api.service[61776]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:31:44 user devstack@n-api.service[61776]: method: > Apr 14 13:31:44 user devstack@n-api.service[61776]: exception: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:44 user devstack@n-api.service[61776]: action_args: {'id': '6e646c88-579e-4ea1-b987-da1c7194a064'} Apr 14 13:31:44 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:31:44 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:31:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:31:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-bf925c14-76de-45f5-8339-ba28d7e35de1 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 404 len: 111 microversion: 2.1 time: 0.031564 Apr 14 13:31:44 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 327/964] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:44 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-53409261", "imageRef": "364f8f0e-9be3-4fd9-80d8-be290e16b4b1", "flavorRef": "42", "networks": [{"uuid": "0a1c90dc-274e-4aab-a239-6a786eb8d0be"}], "security_groups": [{"name": "tempest-securitygroup--223865367"}], "key_name": "tempest-keypair-267883713", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] validate_networks() for [('0a1c90dc-274e-4aab-a239-6a786eb8d0be', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:31:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-536af45d-fe5b-4106-b4b0-f09d04a2007d req-415d978d-4f69-4117-8733-ef74ef6b62c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "167e06f3-4a3d-418d-8aaa-4827c749258d", "name": "network-vif-deleted", "tag": "94fca401-a6e6-49b4-bdf9-4419787e733e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-536af45d-fe5b-4106-b4b0-f09d04a2007d req-415d978d-4f69-4117-8733-ef74ef6b62c2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-536af45d-fe5b-4106-b4b0-f09d04a2007d req-415d978d-4f69-4117-8733-ef74ef6b62c2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-536af45d-fe5b-4106-b4b0-f09d04a2007d req-415d978d-4f69-4117-8733-ef74ef6b62c2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-536af45d-fe5b-4106-b4b0-f09d04a2007d req-415d978d-4f69-4117-8733-ef74ef6b62c2 service nova] Creating event network-vif-deleted:94fca401-a6e6-49b4-bdf9-4419787e733e for instance 167e06f3-4a3d-418d-8aaa-4827c749258d on user Apr 14 13:31:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-536af45d-fe5b-4106-b4b0-f09d04a2007d req-415d978d-4f69-4117-8733-ef74ef6b62c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033990 Apr 14 13:31:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 320/965] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for project 4b197f1df57f4dee9757639cf861eb97. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:31:44 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for user 9169729edbd04fd5a74d2cffd0aa437f and project 4b197f1df57f4dee9757639cf861eb97. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:31:45 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:31:45 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='364f8f0e-9be3-4fd9-80d8-be290e16b4b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:31:45 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-4f7dc24c-36f5-4224-8c81-a1c2b9cce8e3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.884994 Apr 14 13:31:45 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 319/966] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:31:44 2023] POST /compute/v2.1/servers => generated 403 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:31:45 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-a776afe1-5741-4a47-bfef-f574c157535a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:45 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-a776afe1-5741-4a47-bfef-f574c157535a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:45 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-a776afe1-5741-4a47-bfef-f574c157535a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-a776afe1-5741-4a47-bfef-f574c157535a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227" status: 200 len: 1230 microversion: 2.1 time: 0.073085 Apr 14 13:31:45 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 328/967] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:45 2023] GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227 => generated 1230 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] HTTP exception thrown: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Request method failure captured: Apr 14 13:31:46 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b HTTP/1.1 Apr 14 13:31:46 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:31:46 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:31:46 user devstack@n-api.service[61774]: Connection: close Apr 14 13:31:46 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:31:46 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:31:46 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:31:46 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:31:46 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVJ0L00ckejtJxU6XxKcFnn6_fUq6MVy8jUhoW5zU-iCCo5FfT7SVU1imrpzzLyLqVWhKrdZL2FUUV0wSSXiXfypWSHk8TAApNW7f0JUebvLMSuDHVG4auQs3vsgbBNDjz2C4AuNKDVoIxbeRA4BtsERYW4_CPmZUYS_MZeKXxFHvfw Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Project-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Tenant-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:46 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:46 user devstack@n-api.service[61774]: X-User: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:46 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:31:46 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:31:46 user devstack@n-api.service[61774]: X-User-Id: f04370605aec40a0a53a080c1e8bf8a8 Apr 14 13:31:46 user devstack@n-api.service[61774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:46 user devstack@n-api.service[61774]: method: > Apr 14 13:31:46 user devstack@n-api.service[61774]: exception: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61774]: action_args: {'id': '1a866f3f-b709-4286-8cef-8e3b35f26d0b'} Apr 14 13:31:46 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Returning 404 to user: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:31:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-3b3eb093-052f-40d0-ae49-a23d2e486d75 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 404 len: 111 microversion: 2.20 time: 0.034897 Apr 14 13:31:46 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 321/968] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:31:46 2023] DELETE /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] [instance: 1a866f3f-b709-4286-8cef-8e3b35f26d0b] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] HTTP exception thrown: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Request method failure captured: Apr 14 13:31:46 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b HTTP/1.1 Apr 14 13:31:46 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:31:46 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:31:46 user devstack@n-api.service[61775]: Connection: close Apr 14 13:31:46 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:31:46 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:31:46 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:31:46 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:31:46 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVJ0L00ckejtJxU6XxKcFnn6_fUq6MVy8jUhoW5zU-iCCo5FfT7SVU1imrpzzLyLqVWhKrdZL2FUUV0wSSXiXfypWSHk8TAApNW7f0JUebvLMSuDHVG4auQs3vsgbBNDjz2C4AuNKDVoIxbeRA4BtsERYW4_CPmZUYS_MZeKXxFHvfw Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Project-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8f0fee50983a4e31b1689dc77b1c4db1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Tenant-Id: 8f0fee50983a4e31b1689dc77b1c4db1 Apr 14 13:31:46 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1344633518 Apr 14 13:31:46 user devstack@n-api.service[61775]: X-User: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:46 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:31:46 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:31:46 user devstack@n-api.service[61775]: X-User-Id: f04370605aec40a0a53a080c1e8bf8a8 Apr 14 13:31:46 user devstack@n-api.service[61775]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1344633518-project-member Apr 14 13:31:46 user devstack@n-api.service[61775]: method: > Apr 14 13:31:46 user devstack@n-api.service[61775]: exception: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61775]: action_args: {'id': '1a866f3f-b709-4286-8cef-8e3b35f26d0b'} Apr 14 13:31:46 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. Apr 14 13:31:46 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:31:46 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] Returning 404 to user: Instance 1a866f3f-b709-4286-8cef-8e3b35f26d0b could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:31:46 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-c9d88137-d160-419f-adc4-46fd6f8bac95 tempest-AttachVolumeShelveTestJSON-1344633518 tempest-AttachVolumeShelveTestJSON-1344633518-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b" status: 404 len: 111 microversion: 2.20 time: 0.042505 Apr 14 13:31:46 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 320/969] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:31:46 2023] GET /compute/v2.1/servers/1a866f3f-b709-4286-8cef-8e3b35f26d0b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:31:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe769254-aa7a-4038-abb6-18628dbcd227", "tag": "08aca6e2-fbdf-43c4-878a-45558c029e27"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] Creating event network-changed:08aca6e2-fbdf-43c4-878a-45558c029e27 for instance fe769254-aa7a-4038-abb6-18628dbcd227 on user Apr 14 13:31:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-125b9ce9-a4df-4e77-9c9c-5fe54b104db7 req-1540aa7a-6fcc-4514-b53e-dc5e36befe82 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031492 Apr 14 13:31:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 329/970] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:48 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:31:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-832c3638-dde8-4748-8eed-4c6b809a8b93 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f" status: 200 len: 1536 microversion: 2.1 time: 0.448391 Apr 14 13:31:48 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 322/971] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:31:48 2023] GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f => generated 1536 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:31:49 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe769254-aa7a-4038-abb6-18628dbcd227", "name": "network-vif-plugged", "status": "completed", "tag": "08aca6e2-fbdf-43c4-878a-45558c029e27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] Creating event network-vif-plugged:08aca6e2-fbdf-43c4-878a-45558c029e27 for instance fe769254-aa7a-4038-abb6-18628dbcd227 on user Apr 14 13:31:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-fcdd24a9-922c-4262-a6cd-f8b6a84b0f2f req-bbd06c39-df7b-4f9f-845a-04b2286d7e72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052910 Apr 14 13:31:49 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 321/972] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:50 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0f7d33-ba0c-4111-857d-319c5788106f", "tag": "e5381c33-8ca2-44a1-92a9-adda19cd90a5"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] Creating event network-changed:e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f on user Apr 14 13:31:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-6d793e64-4857-4460-9aa8-238287e505d3 req-9c1d4810-65fa-4be1-ad2c-1a64bbcb0fdd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037232 Apr 14 13:31:50 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 330/973] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:50 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "afdd0b4a-209d-47cf-b0c3-6a63b2a16772"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:50 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:50 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-954df7f6-236c-43c9-9ec3-e98119a1bec9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322673 Apr 14 13:31:50 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 323/974] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:31:50 2023] POST /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:51 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe769254-aa7a-4038-abb6-18628dbcd227", "name": "network-vif-plugged", "status": "completed", "tag": "08aca6e2-fbdf-43c4-878a-45558c029e27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:31:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] Creating event network-vif-plugged:08aca6e2-fbdf-43c4-878a-45558c029e27 for instance fe769254-aa7a-4038-abb6-18628dbcd227 on user Apr 14 13:31:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-06200677-8324-44d5-8ae5-9d5f29ff8af8 req-8bc54505-c194-4872-830e-5e8f280b7caa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036790 Apr 14 13:31:51 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 322/975] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:31:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:58 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lazy-loading 'services' on Instance uuid 3c0f7d33-ba0c-4111-857d-319c5788106f {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:31:58 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-271d4fdc-5f27-4028-b219-08356d25d362 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f/os-volume_attachments/afdd0b4a-209d-47cf-b0c3-6a63b2a16772" status: 202 len: 0 microversion: 2.1 time: 0.182773 Apr 14 13:31:58 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 331/976] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:31:58 2023] DELETE /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f/os-volume_attachments/afdd0b4a-209d-47cf-b0c3-6a63b2a16772 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:31:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:31:58 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:31:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:31:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:31:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:31:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a71c3f6f-26fe-4a93-a53a-77672176f3be tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054529 Apr 14 13:31:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 324/977] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:31:58 2023] GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:02 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a5e5bef8-eab2-4360-a8d0-a7f335efafae tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "POST /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa/action" status: 202 len: 0 microversion: 2.87 time: 0.588503 Apr 14 13:32:02 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 323/978] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 13:32:02 2023] POST /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:32:02 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:02 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:02 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:03 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:03 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:03 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:03 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-1b26e913-0ebb-49eb-8800-315e850e60b4 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 200 len: 1762 microversion: 2.87 time: 0.305563 Apr 14 13:32:03 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 332/979] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:32:02 2023] GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 1762 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:32:03 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-unplugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:03 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] Creating event network-vif-unplugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:32:03 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-45547d14-eec4-46b1-921c-0df9b98b65f1 req-764e03e4-39ba-4c2c-8559-2ed48cea5e7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046619 Apr 14 13:32:03 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 325/980] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:05 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61775) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 13:32:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d38f1dc8-70a7-46ad-8e39-92087fe706c6 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "POST /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb/action" status: 202 len: 0 microversion: 2.1 time: 0.136255 Apr 14 13:32:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 324/981] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:32:05 2023] POST /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=25 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=34,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:05 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:32:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-8feb2677-7061-4d19-8412-4e33f9be8fd2 req-6efc006b-145f-44d4-9c2f-3da878ff9131 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051241 Apr 14 13:32:05 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 326/982] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:05 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-cabd2df8-ffdc-4efa-978b-ec0685c7ac02 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 200 len: 1506 microversion: 2.1 time: 0.318956 Apr 14 13:32:05 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 333/983] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:32:05 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:32:07 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}, {"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:07 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:32:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:32:07 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-2438a6ba-8d68-47b7-b6d7-a340828a0975 req-fd6befba-8b1a-44fe-accb-5ceaee3416d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032760 Apr 14 13:32:07 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 325/984] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:12 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:13 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140e52ed81ba492abc14653240501497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad49f75bbe9461b936963e8dc6c8be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:13 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-0c50fe2f-5952-497a-8078-6ebb2ad55c5e tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a" status: 200 len: 1567 microversion: 2.1 time: 0.271266 Apr 14 13:32:13 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 327/985] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:32:12 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:32:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] Creating event network-changed:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:32:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-4badb53f-8202-49b1-b8a8-a8093a8a42ac req-a404da49-69b6-4745-9ba3-ccd684a8f1dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031495 Apr 14 13:32:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 334/986] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:16 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-841941355"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:16 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:16 user devstack@n-api.service[61775]: INFO nova.network.security_group_api [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Removing security group a89c5a84-9acf-49fc-85d8-8359914e58df from port 40073711-7679-449b-8856-60989099101c Apr 14 13:32:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-04d786c8-ac84-448b-9e96-4ca531ea2473 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "POST /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/action" status: 202 len: 0 microversion: 2.1 time: 1.122518 Apr 14 13:32:17 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 326/987] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:32:16 2023] POST /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/action => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:32:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:17 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=14 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] Creating event network-changed:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:32:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-c4ad34b3-3379-4f4e-97a0-c9d160028cac req-9869c0e9-79d4-438f-90f1-1948461b873e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038510 Apr 14 13:32:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 328/988] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:18 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lazy-loading 'services' on Instance uuid 9970f98b-ade9-4d08-a88d-b11a222adcf9 {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:32:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-edf3d6aa-daa9-469a-a8b3-210a3b2e88f6 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments/3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d" status: 202 len: 0 microversion: 2.1 time: 0.238869 Apr 14 13:32:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 335/989] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:32:18 2023] DELETE /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments/3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:32:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:18 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-36ffd5e0-4749-4b4a-9eff-8c5feb06ff86 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069174 Apr 14 13:32:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 327/990] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:32:18 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:18 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:18 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:32:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-0e4629f5-6a10-4f8c-bd2f-8ef621f81073 req-3ebc4626-607f-4d57-9d4c-92e6e0b98b93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033832 Apr 14 13:32:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 329/991] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:19 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:19 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:19 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] Creating event network-changed:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:32:19 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-87065d21-fb3d-42aa-8ebb-8c1204913e54 req-6c032093-67ed-485e-9278-d1d2579f3fb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Apr 14 13:32:19 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 336/992] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:20 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:20 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:32:20 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-70eb8e32-765a-4595-843f-440b32a135ea req-020c6358-0864-46b1-8a48-6050d40d0214 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038222 Apr 14 13:32:20 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 328/993] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=9 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:30 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:32:30 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d HTTP/1.1 Apr 14 13:32:30 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:32:30 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:32:30 user devstack@n-api.service[61774]: Connection: close Apr 14 13:32:30 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:32:30 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:32:30 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:32:30 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:32:30 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:32:30 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:32:30 user devstack@n-api.service[61774]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:32:30 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:32:30 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:32:30 user devstack@n-api.service[61774]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:32:30 user devstack@n-api.service[61774]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:32:30 user devstack@n-api.service[61774]: method: > Apr 14 13:32:30 user devstack@n-api.service[61774]: exception: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:32:30 user devstack@n-api.service[61774]: action_args: {'id': '167e06f3-4a3d-418d-8aaa-4827c749258d'} Apr 14 13:32:30 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:32:30 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:32:30 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:32:30 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9a13096a-b13b-4313-895d-9c6824b81ef3 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d" status: 404 len: 111 microversion: 2.1 time: 0.041377 Apr 14 13:32:30 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 330/994] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:32:30 2023] GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:32:30 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=7 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:30 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:30 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1586008634", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-212867192", "security_groups": [{"name": "tempest-secgroup-smoke-2072975958"}], "block_device_mapping_v2": [{"uuid": "9056cb37-c575-40f0-9cc7-7cd88b944cd4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "32e04661-5709-44d8-b16f-bc45b62317fc"}]}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:30 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] validate_networks() for [('32e04661-5709-44d8-b16f-bc45b62317fc', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for user bb40413bd0c3490d97b997f69c930f72 and project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:32:31 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9056cb37-c575-40f0-9cc7-7cd88b944cd4',volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:32:31 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-a4ba00bb-229a-497a-82da-7d827a3195d5 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.987497 Apr 14 13:32:31 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 337/995] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:32:30 2023] POST /compute/v2.1/servers => generated 404 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:32:31 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:31 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:31 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-fa0cf370-3804-4178-b4b2-784c4ab2be82 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:31 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-fa0cf370-3804-4178-b4b2-784c4ab2be82 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:31 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-fa0cf370-3804-4178-b4b2-784c4ab2be82 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:31 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-fa0cf370-3804-4178-b4b2-784c4ab2be82 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab" status: 200 len: 1089 microversion: 2.1 time: 0.079463 Apr 14 13:32:31 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 329/996] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:32:31 2023] GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab => generated 1089 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:32:34 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f323dce-be29-4437-8992-4bfec3ba29ab", "tag": "a23e9593-5778-4287-890a-07585622bc27"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:34 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] Creating event network-changed:a23e9593-5778-4287-890a-07585622bc27 for instance 5f323dce-be29-4437-8992-4bfec3ba29ab on user Apr 14 13:32:34 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-8f8b6b1d-91bb-49b6-84fe-323d237a9638 req-fa0ce9c8-fb0b-41ac-aa3a-fb4ec919ade6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043044 Apr 14 13:32:34 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 331/997] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:35 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:35 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:36 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:36 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-0cb2e9b2-f624-40f8-a25e-6a335608b665 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227" status: 200 len: 1537 microversion: 2.1 time: 0.900325 Apr 14 13:32:36 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 338/998] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:32:35 2023] GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227 => generated 1537 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:32:41 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f323dce-be29-4437-8992-4bfec3ba29ab", "name": "network-vif-plugged", "status": "completed", "tag": "a23e9593-5778-4287-890a-07585622bc27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] Creating event network-vif-plugged:a23e9593-5778-4287-890a-07585622bc27 for instance 5f323dce-be29-4437-8992-4bfec3ba29ab on user Apr 14 13:32:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-5e9b748b-b036-4bae-898c-f3343169a353 req-383b5ebd-d84a-4884-9217-0ad7b7957fb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034460 Apr 14 13:32:41 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 330/999] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:43 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f323dce-be29-4437-8992-4bfec3ba29ab", "name": "network-vif-plugged", "status": "completed", "tag": "a23e9593-5778-4287-890a-07585622bc27"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:43 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] Creating event network-vif-plugged:a23e9593-5778-4287-890a-07585622bc27 for instance 5f323dce-be29-4437-8992-4bfec3ba29ab on user Apr 14 13:32:43 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-aafdde75-b5b9-4a98-9d64-eed8d1aea356 req-b4d215e6-e600-47ed-a9bb-5f8afa0f47bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041181 Apr 14 13:32:43 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 332/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=8 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:48 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:48 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e67d95f1-70e8-4583-bd62-57e0d65caaa7 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060533 Apr 14 13:32:48 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 339/1001] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:32:48 2023] GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:32:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0f7d33-ba0c-4111-857d-319c5788106f", "tag": "e5381c33-8ca2-44a1-92a9-adda19cd90a5"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] Creating event network-changed:e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f on user Apr 14 13:32:49 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-53ce726d-1d7a-460c-be9d-5030fc5ef93d req-733eaedd-c500-44e3-b0c0-662093b9a6b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032250 Apr 14 13:32:49 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 333/1002] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:49 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:32:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-4a0c3e9d-8e58-49be-ba13-34fcccb40342 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f" status: 204 len: 0 microversion: 2.1 time: 0.127805 Apr 14 13:32:49 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 331/1003] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:32:49 2023] DELETE /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:32:49 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:49 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:50 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ac5e7348-86ae-4428-ab44-b73a030b0ff6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f" status: 200 len: 1661 microversion: 2.1 time: 0.486568 Apr 14 13:32:50 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 340/1004] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:32:49 2023] GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f => generated 1661 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:32:50 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0f7d33-ba0c-4111-857d-319c5788106f", "name": "network-vif-unplugged", "status": "completed", "tag": "e5381c33-8ca2-44a1-92a9-adda19cd90a5"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:50 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:50 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] Creating event network-vif-unplugged:e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f on user Apr 14 13:32:50 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-bde46aef-21cf-49c8-bbaa-ba0fd9cd8bde req-0d432ad2-c03a-46f3-9a92-e399fb3cda37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033455 Apr 14 13:32:50 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 334/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:51 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0f7d33-ba0c-4111-857d-319c5788106f", "name": "network-vif-deleted", "tag": "e5381c33-8ca2-44a1-92a9-adda19cd90a5"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:51 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] Creating event network-vif-deleted:e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f on user Apr 14 13:32:51 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-aef4a545-a868-4657-abdf-6a1862aaf726 req-84d70d74-febc-4aa1-b29c-ce3a47670715 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035635 Apr 14 13:32:51 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 332/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:52 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0f7d33-ba0c-4111-857d-319c5788106f", "name": "network-vif-plugged", "status": "completed", "tag": "e5381c33-8ca2-44a1-92a9-adda19cd90a5"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:32:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:52 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] Creating event network-vif-plugged:e5381c33-8ca2-44a1-92a9-adda19cd90a5 for instance 3c0f7d33-ba0c-4111-857d-319c5788106f on user Apr 14 13:32:52 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0f46e177-5280-4e44-8e33-7006d051d884 req-a3b7d832-349b-466e-9515-2fa9d1eed0ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044665 Apr 14 13:32:52 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 341/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:32:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:53 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9abddf93-4294-4000-922f-c51f45245207 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 200 len: 1768 microversion: 2.87 time: 0.436803 Apr 14 13:32:53 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 335/1008] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:32:53 2023] GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 1768 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:32:55 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:32:55 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:32:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:32:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:32:55 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:32:56 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:32:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0952af5d-fec0-4ece-b732-fea7e3475e01 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 200 len: 1551 microversion: 2.1 time: 0.322568 Apr 14 13:32:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 333/1009] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:32:55 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 1551 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=14 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-6e82ab23-1d7e-4fe2-99a2-71083fb555af tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053579 Apr 14 13:33:08 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 342/1010] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:33:08 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=16 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=14 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] HTTP exception thrown: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 is not attached to volume 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Request method failure captured: Apr 14 13:33:08 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments/3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d HTTP/1.1 Apr 14 13:33:08 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:33:08 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:33:08 user devstack@n-api.service[61774]: Connection: close Apr 14 13:33:08 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:33:08 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:33:08 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:33:08 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:33:08 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVOAgGMWtn6pNyHv4_KRUd7j3GPn9PujcZbzgfXnWPPatv8H7GPtp860X0CtLwVi07D8jcXDreIs4UXzg8Ab48WMgFNlOaZCzdtOYVNlcVS_O1aEE96ezBNFZlL4On-6BUxS8GaAGCydT918fgrDQojFHCnHy7wxEuz2K0g7fG_UpD8 Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Project-Id: 9ae2e95243bc4e19b093629197fbb173 Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Tenant: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Tenant-Id: 9ae2e95243bc4e19b093629197fbb173 Apr 14 13:33:08 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:33:08 user devstack@n-api.service[61774]: X-User: tempest-TestMinimumBasicScenario-929002235-project-member Apr 14 13:33:08 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:33:08 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:33:08 user devstack@n-api.service[61774]: X-User-Id: 9e1f366e5f9d43b9bbd8be316ddaa3a9 Apr 14 13:33:08 user devstack@n-api.service[61774]: X-User-Name: tempest-TestMinimumBasicScenario-929002235-project-member Apr 14 13:33:08 user devstack@n-api.service[61774]: method: > Apr 14 13:33:08 user devstack@n-api.service[61774]: exception: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 is not attached to volume 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d Apr 14 13:33:08 user devstack@n-api.service[61774]: action_args: {'server_id': '9970f98b-ade9-4d08-a88d-b11a222adcf9', 'id': '3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d'} Apr 14 13:33:08 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d. Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 is not attached to volume 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 is not attached to volume 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d Apr 14 13:33:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Returning 404 to user: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 is not attached to volume 3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:33:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9dab91c3-f065-40d7-be3f-0c13e0abbac2 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments/3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d" status: 404 len: 154 microversion: 2.1 time: 0.092891 Apr 14 13:33:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 336/1011] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:33:08 2023] DELETE /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9/os-volume_attachments/3ab6dc69-cd7c-48a6-9dd1-71df8d70d26d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:12 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:33:12 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ea48d0f6-470f-4976-87c1-0fe2dd6fad1b tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 204 len: 0 microversion: 2.1 time: 0.140543 Apr 14 13:33:12 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 334/1012] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:33:12 2023] DELETE /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:12 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-unplugged", "status": "completed", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:12 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] Creating event network-vif-unplugged:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:33:12 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-44c51a1a-0d51-4ea9-812f-c3499c9751c9 req-35f9ca96-1f29-44fd-90e2-4ecaa2f43e2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080537 Apr 14 13:33:12 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 337/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:12 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e1f366e5f9d43b9bbd8be316ddaa3a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae2e95243bc4e19b093629197fbb173', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:12 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-fe878754-32e7-4bd1-807a-57d79ba96670 tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 200 len: 1544 microversion: 2.1 time: 0.506841 Apr 14 13:33:12 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 343/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:33:12 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 1544 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:13 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140e52ed81ba492abc14653240501497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad49f75bbe9461b936963e8dc6c8be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-d3a33f69-15b4-4324-a2a2-e6f6a6580f93 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a" status: 200 len: 1567 microversion: 2.1 time: 0.244663 Apr 14 13:33:13 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 335/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:33:13 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:33:13 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-d3bb8c5a-4358-465f-bb97-f4c796010daa req-bee17a9d-1fe7-40f0-b031-151c3a760180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-deleted", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d3bb8c5a-4358-465f-bb97-f4c796010daa req-bee17a9d-1fe7-40f0-b031-151c3a760180 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d3bb8c5a-4358-465f-bb97-f4c796010daa req-bee17a9d-1fe7-40f0-b031-151c3a760180 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:13 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d3bb8c5a-4358-465f-bb97-f4c796010daa req-bee17a9d-1fe7-40f0-b031-151c3a760180 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:13 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d3bb8c5a-4358-465f-bb97-f4c796010daa req-bee17a9d-1fe7-40f0-b031-151c3a760180 service nova] Creating event network-vif-deleted:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:33:13 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-d3bb8c5a-4358-465f-bb97-f4c796010daa req-bee17a9d-1fe7-40f0-b031-151c3a760180 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109819 Apr 14 13:33:13 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 338/1016] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9970f98b-ade9-4d08-a88d-b11a222adcf9", "name": "network-vif-plugged", "status": "completed", "tag": "40073711-7679-449b-8856-60989099101c"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] Creating event network-vif-plugged:40073711-7679-449b-8856-60989099101c for instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 on user Apr 14 13:33:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-9fe7c5ee-775c-40f3-b849-33034df1b5a7 req-df5dae4e-6492-4117-affe-442cbb027734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039444 Apr 14 13:33:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 344/1017] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:17 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b76423-23ff-4721-8300-b198286c109a", "tag": "5670a4df-018a-4b12-bf37-a1fada7bfe9e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] Creating event network-changed:5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance 03b76423-23ff-4721-8300-b198286c109a on user Apr 14 13:33:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-7a9ab973-b1f4-4766-afff-49c934db4bcf req-8f4fed91-f50c-44dd-8048-c767e710775b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089522 Apr 14 13:33:17 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 336/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4aa03404-f31f-4d55-b48c-857b42075b60"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:17 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:18 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-07337ca0-4816-422d-9e1b-0e447b830661 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272207 Apr 14 13:33:18 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 339/1019] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:33:17 2023] POST /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:21 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d8dcc79f-bf83-43b8-9448-333b35710113 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab" status: 200 len: 1443 microversion: 2.1 time: 0.233583 Apr 14 13:33:21 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 345/1020] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:33:21 2023] GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab => generated 1443 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:36 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-c84f19d0-b2bc-4a1e-b8c7-ad092dd7b60f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.407387 Apr 14 13:33:36 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 337/1021] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:33:36 2023] GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227/os-interface => generated 283 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=8 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:37 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'services' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:33:37 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e8feab54-7c4b-42b8-837f-daf0fc73b96d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments/4aa03404-f31f-4d55-b48c-857b42075b60" status: 202 len: 0 microversion: 2.1 time: 0.191028 Apr 14 13:33:37 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 340/1022] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:33:37 2023] DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments/4aa03404-f31f-4d55-b48c-857b42075b60 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=8 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=20 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-bed28f7f-18f8-4acf-bbe3-d3b3eaeda03c tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050802 Apr 14 13:33:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 346/1023] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:33:37 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:37 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe769254-aa7a-4038-abb6-18628dbcd227", "tag": "08aca6e2-fbdf-43c4-878a-45558c029e27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:37 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] Creating event network-changed:08aca6e2-fbdf-43c4-878a-45558c029e27 for instance fe769254-aa7a-4038-abb6-18628dbcd227 on user Apr 14 13:33:37 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-e03de2bc-62f6-45d8-8f16-88c6e07b6824 req-abe3129a-cbf2-4bd2-b193-ca4113a860c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033543 Apr 14 13:33:37 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 338/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 3c0f7d33-ba0c-4111-857d-319c5788106f] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:40 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] HTTP exception thrown: Instance 3c0f7d33-ba0c-4111-857d-319c5788106f could not be found. Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Request method failure captured: Apr 14 13:33:40 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f HTTP/1.1 Apr 14 13:33:40 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:33:40 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:33:40 user devstack@n-api.service[61774]: Connection: close Apr 14 13:33:40 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:33:40 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:33:40 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:33:40 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:33:40 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVSM86mnIEVPm7tqirtEJVLcPvnwVOdaEmbcCVaUqsphxKursubogoyGFg59YJgJlROIQzm--7tiU6vy94w9ev1m2Dp8LoPi1wcvq9UoQMLq_AsCQXKl_Fc2Gs7CyquI_LZeD3r_UG6u-uf6ot9MB2LBaPYwi7LSNZ0BCuMjozL9YY0 Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Project-Id: fdd6e06c2dbf479697403fee2b1b72e2 Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestStampPattern-1896841208 Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Tenant: tempest-TestStampPattern-1896841208 Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Tenant-Id: fdd6e06c2dbf479697403fee2b1b72e2 Apr 14 13:33:40 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestStampPattern-1896841208 Apr 14 13:33:40 user devstack@n-api.service[61774]: X-User: tempest-TestStampPattern-1896841208-project-member Apr 14 13:33:40 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:33:40 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:33:40 user devstack@n-api.service[61774]: X-User-Id: d53a298063a346ec9b41110051e689c8 Apr 14 13:33:40 user devstack@n-api.service[61774]: X-User-Name: tempest-TestStampPattern-1896841208-project-member Apr 14 13:33:40 user devstack@n-api.service[61774]: method: > Apr 14 13:33:40 user devstack@n-api.service[61774]: exception: Instance 3c0f7d33-ba0c-4111-857d-319c5788106f could not be found. Apr 14 13:33:40 user devstack@n-api.service[61774]: action_args: {'id': '3c0f7d33-ba0c-4111-857d-319c5788106f'} Apr 14 13:33:40 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c0f7d33-ba0c-4111-857d-319c5788106f could not be found. Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c0f7d33-ba0c-4111-857d-319c5788106f could not be found. Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c0f7d33-ba0c-4111-857d-319c5788106f could not be found. Apr 14 13:33:40 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:33:40 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Returning 404 to user: Instance 3c0f7d33-ba0c-4111-857d-319c5788106f could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:33:40 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7f38701b-6fce-45f7-89d6-babf84c073d6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f" status: 404 len: 111 microversion: 2.1 time: 0.031971 Apr 14 13:33:40 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 341/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:33:40 2023] GET /compute/v2.1/servers/3c0f7d33-ba0c-4111-857d-319c5788106f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:33:41 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-403210657", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "0a1c90dc-274e-4aab-a239-6a786eb8d0be"}], "security_groups": [{"name": "tempest-securitygroup--223865367"}], "key_name": "tempest-keypair-267883713", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "492fdd47-3fa9-474f-83e3-dfaee2a0c94d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:41 user devstack@n-api.service[61776]: DEBUG nova.network.neutron [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] validate_networks() for [('0a1c90dc-274e-4aab-a239-6a786eb8d0be', None, None, None, None, None)] {{(pid=61776) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.virt.hardware [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61776) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for project 4b197f1df57f4dee9757639cf861eb97. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.quota [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for user 9169729edbd04fd5a74d2cffd0aa437f and project 4b197f1df57f4dee9757639cf861eb97. Resources: {'instances', 'cores', 'ram'} {{(pid=61776) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Going to run 1 instances... {{(pid=61776) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:33:42 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='492fdd47-3fa9-474f-83e3-dfaee2a0c94d',volume_size=None,volume_type=None)] {{(pid=61776) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:33:42 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-dd87d822-86ae-464b-b5c9-44a0bd72a3ca tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.766247 Apr 14 13:33:42 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 347/1026] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:33:41 2023] POST /compute/v2.1/servers => generated 403 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:33:42 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-f0e7d356-5a92-4831-b844-4c5741d052b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:42 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-f0e7d356-5a92-4831-b844-4c5741d052b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:42 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-f0e7d356-5a92-4831-b844-4c5741d052b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:42 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-f0e7d356-5a92-4831-b844-4c5741d052b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1074 microversion: 2.1 time: 0.103089 Apr 14 13:33:42 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 339/1027] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:33:42 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1074 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:33:45 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:45 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:45 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] Creating event network-changed:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:33:45 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-d882c6ac-7d82-4108-969f-456854f91ee6 req-b5363fbb-1079-4623-bc2a-40dec04a2201 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032144 Apr 14 13:33:45 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 342/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:46 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] HTTP exception thrown: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 is not attached to volume 57e0498e-3dd2-4931-b8e8-bc188948fa24 Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Request method failure captured: Apr 14 13:33:46 user devstack@n-api.service[61776]: request: DELETE /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments/57e0498e-3dd2-4931-b8e8-bc188948fa24 HTTP/1.1 Apr 14 13:33:46 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:33:46 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:33:46 user devstack@n-api.service[61776]: Connection: close Apr 14 13:33:46 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:33:46 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:33:46 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:33:46 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:33:46 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVSM86mnIEVPm7tqirtEJVLcPvnwVOdaEmbcCVaUqsphxKursubogoyGFg59YJgJlROIQzm--7tiU6vy94w9ev1m2Dp8LoPi1wcvq9UoQMLq_AsCQXKl_Fc2Gs7CyquI_LZeD3r_UG6u-uf6ot9MB2LBaPYwi7LSNZ0BCuMjozL9YY0 Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Project-Id: fdd6e06c2dbf479697403fee2b1b72e2 Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Project-Name: tempest-TestStampPattern-1896841208 Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Tenant: tempest-TestStampPattern-1896841208 Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Tenant-Id: fdd6e06c2dbf479697403fee2b1b72e2 Apr 14 13:33:46 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-TestStampPattern-1896841208 Apr 14 13:33:46 user devstack@n-api.service[61776]: X-User: tempest-TestStampPattern-1896841208-project-member Apr 14 13:33:46 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:33:46 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:33:46 user devstack@n-api.service[61776]: X-User-Id: d53a298063a346ec9b41110051e689c8 Apr 14 13:33:46 user devstack@n-api.service[61776]: X-User-Name: tempest-TestStampPattern-1896841208-project-member Apr 14 13:33:46 user devstack@n-api.service[61776]: method: > Apr 14 13:33:46 user devstack@n-api.service[61776]: exception: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 is not attached to volume 57e0498e-3dd2-4931-b8e8-bc188948fa24 Apr 14 13:33:46 user devstack@n-api.service[61776]: action_args: {'server_id': '31781f5a-460a-41e3-bdcf-9cb20f050ba3', 'id': '57e0498e-3dd2-4931-b8e8-bc188948fa24'} Apr 14 13:33:46 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 57e0498e-3dd2-4931-b8e8-bc188948fa24. Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 is not attached to volume 57e0498e-3dd2-4931-b8e8-bc188948fa24 Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 is not attached to volume 57e0498e-3dd2-4931-b8e8-bc188948fa24 Apr 14 13:33:46 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:33:46 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Returning 404 to user: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 is not attached to volume 57e0498e-3dd2-4931-b8e8-bc188948fa24 {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:33:46 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-24f46291-3f67-490d-b740-182b2e4571e2 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments/57e0498e-3dd2-4931-b8e8-bc188948fa24" status: 404 len: 154 microversion: 2.1 time: 0.090885 Apr 14 13:33:46 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 348/1029] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:33:46 2023] DELETE /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3/os-volume_attachments/57e0498e-3dd2-4931-b8e8-bc188948fa24 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:33:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31781f5a-460a-41e3-bdcf-9cb20f050ba3", "tag": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] Creating event network-changed:c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 on user Apr 14 13:33:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-82cf03b0-2267-4dea-85cf-499c0f9b1f43 req-9993d105-96df-49f0-84a9-5c5d7d843c0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104352 Apr 14 13:33:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 343/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-e30d65bc-e7c5-4497-b076-6b80312be990 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3" status: 204 len: 0 microversion: 2.1 time: 0.129072 Apr 14 13:33:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 340/1031] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:33:47 2023] DELETE /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:47 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd53a298063a346ec9b41110051e689c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdd6e06c2dbf479697403fee2b1b72e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-97558407-e828-45f9-a628-0f4793527fab tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3" status: 200 len: 1660 microversion: 2.1 time: 0.297579 Apr 14 13:33:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 349/1032] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:33:47 2023] GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3 => generated 1660 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:33:48 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31781f5a-460a-41e3-bdcf-9cb20f050ba3", "name": "network-vif-unplugged", "status": "completed", "tag": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:48 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] Creating event network-vif-unplugged:c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 on user Apr 14 13:33:48 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-fed5e1db-121d-4d85-b12c-b32a447ad53b req-0876bd01-b380-4d9e-8561-f543a4120b9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030137 Apr 14 13:33:48 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 344/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:50 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31781f5a-460a-41e3-bdcf-9cb20f050ba3", "name": "network-vif-plugged", "status": "completed", "tag": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb"}, {"server_uuid": "31781f5a-460a-41e3-bdcf-9cb20f050ba3", "name": "network-vif-deleted", "tag": "c55e9150-0706-4fa7-9c0c-e94b7aefc8eb"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:50 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:50 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Creating event network-vif-plugged:c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 on user Apr 14 13:33:50 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] Creating event network-vif-deleted:c55e9150-0706-4fa7-9c0c-e94b7aefc8eb for instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 on user Apr 14 13:33:50 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-6a476865-8479-4a4b-88cf-757644734ef4 req-ac564ca0-ccdc-4cb7-9913-025ad50bb58d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031507 Apr 14 13:33:50 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 341/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:51 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-plugged", "status": "completed", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:51 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:51 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:51 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:51 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] Creating event network-vif-plugged:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:33:51 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-e3d445fc-762c-49fd-891f-ca763de4b65b req-1cdf1933-9473-42e4-a9ad-6bcc2b964f42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032199 Apr 14 13:33:51 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 350/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:53 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-plugged", "status": "completed", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:53 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] Creating event network-vif-plugged:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:33:53 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-56945636-9852-4319-a68d-ae5dd8ccb4ec req-2a6b4ed9-e42f-46c6-bef6-84a3c09ec1d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031749 Apr 14 13:33:53 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 345/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:53 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:33:53 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-79405ebb-f05b-4f49-86d8-3f4292bd3d14 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 204 len: 0 microversion: 2.87 time: 0.257924 Apr 14 13:33:53 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 342/1037] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:33:53 2023] DELETE /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell0:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:53 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:54 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:54 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:54 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2044d5af-23e8-4e7c-b0cb-77e21a4cdfd8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 200 len: 1774 microversion: 2.87 time: 0.260592 Apr 14 13:33:54 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 351/1038] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:33:53 2023] GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 1774 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:33:54 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-unplugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:54 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] Creating event network-vif-unplugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:33:54 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-7eaa50d7-8a1f-4f18-b721-be4220238344 req-408a0bc1-9a33-4bbd-a8d4-25514658c639 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029687 Apr 14 13:33:54 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 346/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:56 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-plugged", "status": "completed", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}, {"server_uuid": "626abaa0-3f53-42cc-978e-21f0a80232fa", "name": "network-vif-deleted", "tag": "7d5d9e2b-b502-494a-ac52-70930eda92ac"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:56 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Creating event network-vif-plugged:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:33:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] Creating event network-vif-deleted:7d5d9e2b-b502-494a-ac52-70930eda92ac for instance 626abaa0-3f53-42cc-978e-21f0a80232fa on user Apr 14 13:33:56 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-796ed71e-06b8-4017-82c0-3aae91f19a02 req-b086effe-6eac-4b04-bc1a-f3eee4fbf3dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038048 Apr 14 13:33:56 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 343/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:56 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:56 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:56 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:56 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:56 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] Creating event network-changed:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:33:57 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-456a3c73-e9ee-473d-b08d-20889d198f5d req-77915b8b-506c-4382-85af-7d34fd3f26d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037586 Apr 14 13:33:57 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 347/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:57 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:33:57 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9f9563bc-9d43-41b3-8b19-3ca9ae7100db tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 204 len: 0 microversion: 2.1 time: 0.141378 Apr 14 13:33:57 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 352/1042] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:33:56 2023] DELETE /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:57 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01b25b886ade4e6ea689010d655d99a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ba9f3b2ecb541aba4516734fdebd316', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:33:57 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-6cd595ba-1f7f-41ae-94a4-0d19ba22a132 tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 200 len: 1557 microversion: 2.1 time: 0.539464 Apr 14 13:33:57 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 344/1043] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:33:57 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 1557 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:33:58 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-1bd699c3-5272-44fc-ab5d-f12915fea088 req-92cdbbf0-5cf3-4f2e-97b8-c353efb31365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-deleted", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1bd699c3-5272-44fc-ab5d-f12915fea088 req-92cdbbf0-5cf3-4f2e-97b8-c353efb31365 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1bd699c3-5272-44fc-ab5d-f12915fea088 req-92cdbbf0-5cf3-4f2e-97b8-c353efb31365 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:58 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-1bd699c3-5272-44fc-ab5d-f12915fea088 req-92cdbbf0-5cf3-4f2e-97b8-c353efb31365 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-1bd699c3-5272-44fc-ab5d-f12915fea088 req-92cdbbf0-5cf3-4f2e-97b8-c353efb31365 service nova] Creating event network-vif-deleted:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:33:58 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-1bd699c3-5272-44fc-ab5d-f12915fea088 req-92cdbbf0-5cf3-4f2e-97b8-c353efb31365 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030351 Apr 14 13:33:58 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 348/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:33:59 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-unplugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}, {"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}, {"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}, {"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}, {"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-unplugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}, {"server_uuid": "04cf64b3-e51b-418f-94f6-7597c4cd74bb", "name": "network-vif-plugged", "status": "completed", "tag": "2a3ecee8-e3fc-433e-81d5-f0c9decfd248"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:33:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:33:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:33:59 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:33:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Creating event network-vif-unplugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:33:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:33:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:33:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:33:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Creating event network-vif-unplugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:33:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] Creating event network-vif-plugged:2a3ecee8-e3fc-433e-81d5-f0c9decfd248 for instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb on user Apr 14 13:33:59 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-d58c8c13-7b70-48ba-931d-3c76797f8564 req-429bae91-4ded-4f60-a719-59651c904ee2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.046117 Apr 14 13:33:59 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 353/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:33:59 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] [instance: 9970f98b-ade9-4d08-a88d-b11a222adcf9] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:02 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] HTTP exception thrown: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 could not be found. Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Request method failure captured: Apr 14 13:34:02 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 HTTP/1.1 Apr 14 13:34:02 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:34:02 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:34:02 user devstack@n-api.service[61775]: Connection: close Apr 14 13:34:02 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:34:02 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:34:02 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:34:02 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:34:02 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVOAgGMWtn6pNyHv4_KRUd7j3GPn9PujcZbzgfXnWPPatv8H7GPtp860X0CtLwVi07D8jcXDreIs4UXzg8Ab48WMgFNlOaZCzdtOYVNlcVS_O1aEE96ezBNFZlL4On-6BUxS8GaAGCydT918fgrDQojFHCnHy7wxEuz2K0g7fG_UpD8 Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Project-Id: 9ae2e95243bc4e19b093629197fbb173 Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Project-Name: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9ae2e95243bc4e19b093629197fbb173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Tenant: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Tenant-Id: 9ae2e95243bc4e19b093629197fbb173 Apr 14 13:34:02 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TestMinimumBasicScenario-929002235 Apr 14 13:34:02 user devstack@n-api.service[61775]: X-User: tempest-TestMinimumBasicScenario-929002235-project-member Apr 14 13:34:02 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:34:02 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:34:02 user devstack@n-api.service[61775]: X-User-Id: 9e1f366e5f9d43b9bbd8be316ddaa3a9 Apr 14 13:34:02 user devstack@n-api.service[61775]: X-User-Name: tempest-TestMinimumBasicScenario-929002235-project-member Apr 14 13:34:02 user devstack@n-api.service[61775]: method: > Apr 14 13:34:02 user devstack@n-api.service[61775]: exception: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 could not be found. Apr 14 13:34:02 user devstack@n-api.service[61775]: action_args: {'id': '9970f98b-ade9-4d08-a88d-b11a222adcf9'} Apr 14 13:34:02 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 could not be found. Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 could not be found. Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 could not be found. Apr 14 13:34:02 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:02 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Returning 404 to user: Instance 9970f98b-ade9-4d08-a88d-b11a222adcf9 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:34:02 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-0c0f334c-91b6-412a-ae8d-18aec020b4cb tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9" status: 404 len: 111 microversion: 2.1 time: 0.036468 Apr 14 13:34:02 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 345/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:34:02 2023] GET /compute/v2.1/servers/9970f98b-ade9-4d08-a88d-b11a222adcf9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:34:02 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-82a3f3d5-a45f-4df9-aa9c-49a82546f73e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] Calling method '.version_select at 0x7fa743832830>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:02 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-82a3f3d5-a45f-4df9-aa9c-49a82546f73e tempest-TestMinimumBasicScenario-929002235 tempest-TestMinimumBasicScenario-929002235-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1166797782" status: 202 len: 0 microversion: 2.1 time: 0.075486 Apr 14 13:34:02 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 349/1047] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 13:34:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1166797782 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:21 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:22 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:34:22 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-faa7ca75-3441-44a0-9e20-99f569221ac4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab" status: 200 len: 1443 microversion: 2.1 time: 0.250325 Apr 14 13:34:22 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 354/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:34:21 2023] GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab => generated 1443 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:34:24 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f323dce-be29-4437-8992-4bfec3ba29ab", "tag": "a23e9593-5778-4287-890a-07585622bc27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:34:24 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:24 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:24 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] Creating event network-changed:a23e9593-5778-4287-890a-07585622bc27 for instance 5f323dce-be29-4437-8992-4bfec3ba29ab on user Apr 14 13:34:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-040ffc54-a822-4208-a0f9-10e634c557c3 req-aafd7808-848a-4c3c-a49b-4481418d7372 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058983 Apr 14 13:34:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 346/1049] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:34:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:27 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:27 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-86ae2d97-5df8-45a4-8fbc-ec87bde1f1fc tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059802 Apr 14 13:34:27 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 350/1050] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:34:27 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:34:31 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f53f31e-30b8-43bc-8e15-d99dc1bedeaa"}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:34:31 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:31 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:31 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1569614272", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-212867192", "security_groups": [{"name": "tempest-secgroup-smoke-2072975958"}], "block_device_mapping_v2": [{"uuid": "fa139a63-05a5-4336-97a0-e22d07bcd8df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "32e04661-5709-44d8-b16f-bc45b62317fc"}]}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:34:31 user devstack@n-api.service[61775]: DEBUG nova.network.neutron [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] validate_networks() for [('32e04661-5709-44d8-b16f-bc45b62317fc', None, None, None, None, None)] {{(pid=61775) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 13:34:31 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-75ae68e4-f50d-4df4-918f-d1880f1d0d02 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387095 Apr 14 13:34:31 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 355/1051] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:34:31 2023] POST /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image limits 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Flavor pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Image pref 0:0:0 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.virt.hardware [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61775) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.quota [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Getting quotas for user bb40413bd0c3490d97b997f69c930f72 and project 818de6fa330c4c87a3b6228345d9f13a. Resources: {'instances', 'cores', 'ram'} {{(pid=61775) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Going to run 1 instances... {{(pid=61775) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 13:34:32 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa139a63-05a5-4336-97a0-e22d07bcd8df',volume_size=None,volume_type=None)] {{(pid=61775) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 13:34:32 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-16f510ba-4384-4c74-818d-194845344e9b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.824938 Apr 14 13:34:32 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 347/1052] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 13:34:31 2023] POST /compute/v2.1/servers => generated 404 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 13:34:32 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b03c0501-b7b1-4538-b65e-c50e64266ebc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:32 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-b03c0501-b7b1-4538-b65e-c50e64266ebc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:32 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-b03c0501-b7b1-4538-b65e-c50e64266ebc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:34:32 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b03c0501-b7b1-4538-b65e-c50e64266ebc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" status: 200 len: 1089 microversion: 2.1 time: 0.067400 Apr 14 13:34:32 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 351/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:34:32 2023] GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:32 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:34:32 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-e2d90aca-62d9-4ec0-ab8b-621beb1de49d tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1426 microversion: 2.1 time: 0.238539 Apr 14 13:34:32 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 356/1054] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:34:32 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1426 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:34:35 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1", "tag": "efa8cf9b-10fd-48d5-a01d-160cb930bc07"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:34:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:35 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] Creating event network-changed:efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 on user Apr 14 13:34:35 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-e3f2024d-7517-4344-828e-a9a7abe18455 req-5b21beee-0235-4f8f-bbe8-a2525500c09d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105430 Apr 14 13:34:35 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 348/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:34:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] [instance: 31781f5a-460a-41e3-bdcf-9cb20f050ba3] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] HTTP exception thrown: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 could not be found. Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Request method failure captured: Apr 14 13:34:38 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3 HTTP/1.1 Apr 14 13:34:38 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:34:38 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:34:38 user devstack@n-api.service[61774]: Connection: close Apr 14 13:34:38 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:34:38 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:34:38 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:34:38 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:34:38 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVSM86mnIEVPm7tqirtEJVLcPvnwVOdaEmbcCVaUqsphxKursubogoyGFg59YJgJlROIQzm--7tiU6vy94w9ev1m2Dp8LoPi1wcvq9UoQMLq_AsCQXKl_Fc2Gs7CyquI_LZeD3r_UG6u-uf6ot9MB2LBaPYwi7LSNZ0BCuMjozL9YY0 Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Project-Id: fdd6e06c2dbf479697403fee2b1b72e2 Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestStampPattern-1896841208 Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fdd6e06c2dbf479697403fee2b1b72e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Tenant: tempest-TestStampPattern-1896841208 Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Tenant-Id: fdd6e06c2dbf479697403fee2b1b72e2 Apr 14 13:34:38 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestStampPattern-1896841208 Apr 14 13:34:38 user devstack@n-api.service[61774]: X-User: tempest-TestStampPattern-1896841208-project-member Apr 14 13:34:38 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:34:38 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:34:38 user devstack@n-api.service[61774]: X-User-Id: d53a298063a346ec9b41110051e689c8 Apr 14 13:34:38 user devstack@n-api.service[61774]: X-User-Name: tempest-TestStampPattern-1896841208-project-member Apr 14 13:34:38 user devstack@n-api.service[61774]: method: > Apr 14 13:34:38 user devstack@n-api.service[61774]: exception: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 could not be found. Apr 14 13:34:38 user devstack@n-api.service[61774]: action_args: {'id': '31781f5a-460a-41e3-bdcf-9cb20f050ba3'} Apr 14 13:34:38 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 could not be found. Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 could not be found. Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 could not be found. Apr 14 13:34:38 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:34:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Returning 404 to user: Instance 31781f5a-460a-41e3-bdcf-9cb20f050ba3 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:34:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-494dbaa2-75c3-46bf-95bb-5cec76bf96c9 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3" status: 404 len: 111 microversion: 2.1 time: 0.030411 Apr 14 13:34:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 352/1056] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:34:38 2023] GET /compute/v2.1/servers/31781f5a-460a-41e3-bdcf-9cb20f050ba3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:34:41 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5d12ed03-a90a-48a7-be25-a51219bc4ec6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] Calling method '.version_select at 0x7fa743a02a70>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:41 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-5d12ed03-a90a-48a7-be25-a51219bc4ec6 tempest-TestStampPattern-1896841208 tempest-TestStampPattern-1896841208-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-924006334" status: 202 len: 0 microversion: 2.1 time: 0.029197 Apr 14 13:34:41 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 357/1057] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:34:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-924006334 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell0:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 626abaa0-3f53-42cc-978e-21f0a80232fa] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] HTTP exception thrown: Instance 626abaa0-3f53-42cc-978e-21f0a80232fa could not be found. Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Request method failure captured: Apr 14 13:34:44 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa HTTP/1.1 Apr 14 13:34:44 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:34:44 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:34:44 user devstack@n-api.service[61775]: Connection: close Apr 14 13:34:44 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:34:44 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:34:44 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:34:44 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:34:44 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVI5oc4kA3o0_7I6beMQJ4cetKVQi1aCdbkcA8VjCD63mgZbyHnxEe2hn-Bl_nzwyEM_wn58nCSblLTipzU2RNiXMwY4j5R6hW_Tht6lqDRhR7f_lGSxcrbVvAuPHwO-ya1LKSmflYQqdE1s24Ib0UMzu9y7bqG3U9tkZVGVbJJO1gI Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Project-Id: a573d19b775642bba2f2883e0005492d Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a573d19b775642bba2f2883e0005492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a573d19b775642bba2f2883e0005492d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a573d19b775642bba2f2883e0005492d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Tenant-Id: a573d19b775642bba2f2883e0005492d Apr 14 13:34:44 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:34:44 user devstack@n-api.service[61775]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member Apr 14 13:34:44 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:34:44 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:34:44 user devstack@n-api.service[61775]: X-User-Id: ebc2d46bc1794568841df20b046356c7 Apr 14 13:34:44 user devstack@n-api.service[61775]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member Apr 14 13:34:44 user devstack@n-api.service[61775]: method: > Apr 14 13:34:44 user devstack@n-api.service[61775]: exception: Instance 626abaa0-3f53-42cc-978e-21f0a80232fa could not be found. Apr 14 13:34:44 user devstack@n-api.service[61775]: action_args: {'id': '626abaa0-3f53-42cc-978e-21f0a80232fa'} Apr 14 13:34:44 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 626abaa0-3f53-42cc-978e-21f0a80232fa could not be found. Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 626abaa0-3f53-42cc-978e-21f0a80232fa could not be found. Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 626abaa0-3f53-42cc-978e-21f0a80232fa could not be found. Apr 14 13:34:44 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Returning 404 to user: Instance 626abaa0-3f53-42cc-978e-21f0a80232fa could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:34:44 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-16b35a30-e53f-400a-9344-ae1b4688cc6d tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa" status: 404 len: 111 microversion: 2.87 time: 0.057727 Apr 14 13:34:44 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 349/1058] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:34:44 2023] GET /compute/v2.1/servers/626abaa0-3f53-42cc-978e-21f0a80232fa => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-e12fd2bd-32d2-477c-8f9d-a722a46beaec tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1" status: 204 len: 0 microversion: 2.87 time: 0.182674 Apr 14 13:34:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 353/1059] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:34:44 2023] DELETE /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61776]: DEBUG nova.objects.instance [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'services' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=61776) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:34:44 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-1a0ba9c5-7c8e-476f-80ff-12e339320059 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments/9f53f31e-30b8-43bc-8e15-d99dc1bedeaa" status: 202 len: 0 microversion: 2.1 time: 0.221666 Apr 14 13:34:44 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 358/1060] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:34:44 2023] DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments/9f53f31e-30b8-43bc-8e15-d99dc1bedeaa => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:44 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:44 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-0c65d39f-0d7c-4c64-95d7-d6be7aab98ba tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054683 Apr 14 13:34:44 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 354/1061] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:34:44 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:34:45 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911be82f-bcf1-4b02-a218-ab977b28afe1", "name": "network-vif-unplugged", "status": "completed", "tag": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:34:45 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:34:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:45 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:45 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:34:45 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:34:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] Creating event network-vif-unplugged:98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance 911be82f-bcf1-4b02-a218-ab977b28afe1 on user Apr 14 13:34:45 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-2b457b1e-9e05-475e-81fd-c463f02be858 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1" status: 200 len: 1696 microversion: 2.87 time: 0.392813 Apr 14 13:34:45 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 350/1062] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:34:44 2023] GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1 => generated 1696 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 13:34:45 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-e8694122-aed7-4152-a1f5-668c069a42d8 req-cb49e755-b8c8-405b-bc15-e615fb0d8c10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047467 Apr 14 13:34:45 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 359/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:34:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:34:46 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-e5c7c045-7174-40fa-9811-b86528cb78ff req-efbc7a63-a516-4aaa-a3e6-82703ee7f694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911be82f-bcf1-4b02-a218-ab977b28afe1", "name": "network-vif-deleted", "tag": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:34:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e5c7c045-7174-40fa-9811-b86528cb78ff req-efbc7a63-a516-4aaa-a3e6-82703ee7f694 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e5c7c045-7174-40fa-9811-b86528cb78ff req-efbc7a63-a516-4aaa-a3e6-82703ee7f694 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:46 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-e5c7c045-7174-40fa-9811-b86528cb78ff req-efbc7a63-a516-4aaa-a3e6-82703ee7f694 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-e5c7c045-7174-40fa-9811-b86528cb78ff req-efbc7a63-a516-4aaa-a3e6-82703ee7f694 service nova] Creating event network-vif-deleted:98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance 911be82f-bcf1-4b02-a218-ab977b28afe1 on user Apr 14 13:34:46 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-e5c7c045-7174-40fa-9811-b86528cb78ff req-efbc7a63-a516-4aaa-a3e6-82703ee7f694 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038580 Apr 14 13:34:46 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 355/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:34:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:34:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "911be82f-bcf1-4b02-a218-ab977b28afe1", "name": "network-vif-plugged", "status": "completed", "tag": "98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:34:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] Creating event network-vif-plugged:98c3bad4-02c4-4ee3-ac29-e8fbcbd0eb75 for instance 911be82f-bcf1-4b02-a218-ab977b28afe1 on user Apr 14 13:34:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-b7ffa1e2-f0ad-4e43-bd40-d05c1b40dcaf req-b4eb9c62-90bc-4b2e-90d2-c5281e1bb92d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047291 Apr 14 13:34:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 351/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] [instance: 04cf64b3-e51b-418f-94f6-7597c4cd74bb] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] HTTP exception thrown: Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb could not be found. Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Request method failure captured: Apr 14 13:34:47 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb HTTP/1.1 Apr 14 13:34:47 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:34:47 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:34:47 user devstack@n-api.service[61776]: Connection: close Apr 14 13:34:47 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:34:47 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:34:47 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:34:47 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:34:47 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVTmcmZZfUZx6CGyWZoNe1wMMrIHaUceyUCfwHkm4yAqb2tUEhS0nJvfEJTEjYnCe5HtMzfPIA-rrGTEOFYs6GjDf_Gkft04jdVZoAzVpiuEyA3ZBAdq9-DxqWq3jQclweYPStb2t6zsKxZrS3kqFNNDZapzAUcp3XSZvcl5CC7fu54 Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Project-Id: 6ba9f3b2ecb541aba4516734fdebd316 Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Project-Name: tempest-TestShelveInstance-615050191 Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ba9f3b2ecb541aba4516734fdebd316"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ba9f3b2ecb541aba4516734fdebd316"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ba9f3b2ecb541aba4516734fdebd316"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Tenant: tempest-TestShelveInstance-615050191 Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Tenant-Id: 6ba9f3b2ecb541aba4516734fdebd316 Apr 14 13:34:47 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-TestShelveInstance-615050191 Apr 14 13:34:47 user devstack@n-api.service[61776]: X-User: tempest-TestShelveInstance-615050191-project-member Apr 14 13:34:47 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:34:47 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:34:47 user devstack@n-api.service[61776]: X-User-Id: 01b25b886ade4e6ea689010d655d99a0 Apr 14 13:34:47 user devstack@n-api.service[61776]: X-User-Name: tempest-TestShelveInstance-615050191-project-member Apr 14 13:34:47 user devstack@n-api.service[61776]: method: > Apr 14 13:34:47 user devstack@n-api.service[61776]: exception: Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb could not be found. Apr 14 13:34:47 user devstack@n-api.service[61776]: action_args: {'id': '04cf64b3-e51b-418f-94f6-7597c4cd74bb'} Apr 14 13:34:47 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb could not be found. Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb could not be found. Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb could not be found. Apr 14 13:34:47 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:34:47 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Returning 404 to user: Instance 04cf64b3-e51b-418f-94f6-7597c4cd74bb could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:34:47 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-5a205e5a-cadc-474a-9bc6-5284ff9fe6cb tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb" status: 404 len: 111 microversion: 2.1 time: 0.028682 Apr 14 13:34:47 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 360/1066] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:34:47 2023] GET /compute/v2.1/servers/04cf64b3-e51b-418f-94f6-7597c4cd74bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:34:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-47f7377a-4182-487e-ba18-582d20860aaf tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] Calling method '.version_select at 0x7fa743ade7a0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:34:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-47f7377a-4182-487e-ba18-582d20860aaf tempest-TestShelveInstance-615050191 tempest-TestShelveInstance-615050191-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1155531040" status: 202 len: 0 microversion: 2.1 time: 0.026942 Apr 14 13:34:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 356/1067] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 13:34:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1155531040 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:34:49 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1", "name": "network-vif-plugged", "status": "completed", "tag": "efa8cf9b-10fd-48d5-a01d-160cb930bc07"}, {"server_uuid": "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1", "name": "network-vif-plugged", "status": "completed", "tag": "efa8cf9b-10fd-48d5-a01d-160cb930bc07"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:34:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:34:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:34:49 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:34:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Creating event network-vif-plugged:efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 on user Apr 14 13:34:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] Creating event network-vif-plugged:efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 on user Apr 14 13:34:49 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-f2db67a4-25bf-4f48-adb2-4946a25c78e1 req-081a67af-f991-489e-97e2-d7c98e8aae37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038743 Apr 14 13:34:49 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 352/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:34:48 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:22 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:35:22 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-4240151f-dd9a-4481-a162-06e30defb2fa tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" status: 200 len: 1442 microversion: 2.1 time: 0.233393 Apr 14 13:35:22 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 361/1069] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:35:22 2023] GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => generated 1442 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:32 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:32 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-7ae9d4fb-41b6-4a3f-b8ae-18c50ebc3319 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.188452 Apr 14 13:35:32 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 357/1070] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:35:32 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488/os-interface => generated 282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:34 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:34 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=18 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:34 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe769254-aa7a-4038-abb6-18628dbcd227", "tag": "08aca6e2-fbdf-43c4-878a-45558c029e27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:34 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:34 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] Creating event network-changed:08aca6e2-fbdf-43c4-878a-45558c029e27 for instance fe769254-aa7a-4038-abb6-18628dbcd227 on user Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:34 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-dddbac7d-b878-4f18-9e3f-d1a6dcc947a8 req-465d597e-d485-462e-9b42-4389c9229614 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039747 Apr 14 13:35:34 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 353/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:35:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:34 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:35:34 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-ada0ddfa-8c67-4fa9-92bb-4d9537c021b3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1426 microversion: 2.1 time: 0.315930 Apr 14 13:35:34 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 362/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:35:34 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1426 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Old instance type m1.nano, new instance type m1.micro {{(pid=61774) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for project 4b197f1df57f4dee9757639cf861eb97. Resources: {'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.quota [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Getting quotas for user 9169729edbd04fd5a74d2cffd0aa437f and project 4b197f1df57f4dee9757639cf861eb97. Resources: {'cores', 'ram'} {{(pid=61774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image limits 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Flavor pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Image pref 0:0:0 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 13:35:34 user devstack@n-api.service[61774]: DEBUG nova.virt.hardware [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 13:35:35 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-37fca527-1e04-43c6-879c-86fa991fe4d0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488/action" status: 202 len: 0 microversion: 2.1 time: 0.608506 Apr 14 13:35:35 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 358/1073] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:35:34 2023] POST /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-c8c10242-54df-4a1c-9203-7f5e57f66ad4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053006 Apr 14 13:35:35 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 354/1074] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:35:35 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 911be82f-bcf1-4b02-a218-ab977b28afe1] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] HTTP exception thrown: Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 could not be found. Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Request method failure captured: Apr 14 13:35:35 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1 HTTP/1.1 Apr 14 13:35:35 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:35:35 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:35:35 user devstack@n-api.service[61774]: Connection: close Apr 14 13:35:35 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:35:35 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:35:35 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:35:35 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:35:35 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVI5oc4kA3o0_7I6beMQJ4cetKVQi1aCdbkcA8VjCD63mgZbyHnxEe2hn-Bl_nzwyEM_wn58nCSblLTipzU2RNiXMwY4j5R6hW_Tht6lqDRhR7f_lGSxcrbVvAuPHwO-ya1LKSmflYQqdE1s24Ib0UMzu9y7bqG3U9tkZVGVbJJO1gI Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Project-Id: a573d19b775642bba2f2883e0005492d Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a573d19b775642bba2f2883e0005492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a573d19b775642bba2f2883e0005492d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a573d19b775642bba2f2883e0005492d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Tenant-Id: a573d19b775642bba2f2883e0005492d Apr 14 13:35:35 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:35:35 user devstack@n-api.service[61774]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member Apr 14 13:35:35 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:35:35 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:35:35 user devstack@n-api.service[61774]: X-User-Id: ebc2d46bc1794568841df20b046356c7 Apr 14 13:35:35 user devstack@n-api.service[61774]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member Apr 14 13:35:35 user devstack@n-api.service[61774]: method: > Apr 14 13:35:35 user devstack@n-api.service[61774]: exception: Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 could not be found. Apr 14 13:35:35 user devstack@n-api.service[61774]: action_args: {'id': '911be82f-bcf1-4b02-a218-ab977b28afe1'} Apr 14 13:35:35 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 could not be found. Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 could not be found. Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 could not be found. Apr 14 13:35:35 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Returning 404 to user: Instance 911be82f-bcf1-4b02-a218-ab977b28afe1 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:35:35 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c91a0fa6-b69f-477f-8dcf-0eea1166639c tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1" status: 404 len: 111 microversion: 2.87 time: 0.042728 Apr 14 13:35:35 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 359/1075] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:35:35 2023] GET /compute/v2.1/servers/911be82f-bcf1-4b02-a218-ab977b28afe1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:35:35 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-f1585a11-c44e-437e-b010-2e566abca5b2 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1435 microversion: 2.1 time: 0.240608 Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:35 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 363/1076] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:35:35 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1435 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:35:35 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-9e891634-320e-4fe2-8af2-fd6b00f2509b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 204 len: 0 microversion: 2.87 time: 0.157457 Apr 14 13:35:35 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 355/1077] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:35:35 2023] DELETE /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-unplugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:35 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:35 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] Creating event network-vif-unplugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:35:35 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-90f2df35-7ece-4469-bc74-91839107cd46 req-c0496e58-1ee8-46c4-99f3-6105ab247621 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081631 Apr 14 13:35:35 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 364/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:35:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:35:35 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:35:35 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-08c581e5-2eb9-451a-8565-c120954ca3b8 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 200 len: 1774 microversion: 2.87 time: 0.458260 Apr 14 13:35:35 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 360/1079] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:35:35 2023] GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 1774 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:35:36 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:36 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:36 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] Creating event network-changed:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:35:36 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-ca90ea85-8963-41a3-8d68-7eadd86d7226 req-0f8ab578-93e2-4dc8-ab49-f65d3820fafd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052870 Apr 14 13:35:36 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 356/1080] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:35:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-plugged", "status": "completed", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] Creating event network-vif-plugged:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:35:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-7db15359-34bb-4b92-970f-b02611969cf4 req-c7444e1f-2b96-4bcb-bcad-02f3d4eccc93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040359 Apr 14 13:35:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 365/1081] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:35:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:38 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-f30fd51b-4bd7-436b-bf40-e62d09515472 req-236809a7-7ffe-4d14-87a0-76e69b3d2c53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7cdf352-a517-4296-bc70-400836915095", "name": "network-vif-deleted", "tag": "c5258996-381d-45a2-8447-784b03a4e32e"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f30fd51b-4bd7-436b-bf40-e62d09515472 req-236809a7-7ffe-4d14-87a0-76e69b3d2c53 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f30fd51b-4bd7-436b-bf40-e62d09515472 req-236809a7-7ffe-4d14-87a0-76e69b3d2c53 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:38 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-f30fd51b-4bd7-436b-bf40-e62d09515472 req-236809a7-7ffe-4d14-87a0-76e69b3d2c53 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-f30fd51b-4bd7-436b-bf40-e62d09515472 req-236809a7-7ffe-4d14-87a0-76e69b3d2c53 service nova] Creating event network-vif-deleted:c5258996-381d-45a2-8447-784b03a4e32e for instance b7cdf352-a517-4296-bc70-400836915095 on user Apr 14 13:35:38 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-f30fd51b-4bd7-436b-bf40-e62d09515472 req-236809a7-7ffe-4d14-87a0-76e69b3d2c53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044604 Apr 14 13:35:38 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 361/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:35:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:39 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceb34956-9137-4101-bf06-c0a761320578"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:39 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:39 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:39 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-77595628-eb11-45ba-9331-ce0836980909 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280689 Apr 14 13:35:39 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 357/1083] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:35:39 2023] POST /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:39 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-unplugged", "status": "completed", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}, {"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-plugged", "status": "completed", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:39 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Creating event network-vif-unplugged:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:35:39 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Creating event network-vif-plugged:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:35:39 user devstack@n-api.service[61776]: DEBUG nova.compute.api [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:35:40 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-4118f14b-ba1e-4fb4-a5ff-046e7e0a971b req-9f0d2a49-66c9-42e5-b615-07378f02b54f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037905 Apr 14 13:35:40 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 366/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:35:39 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell0:SELECT=3 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:47 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'services' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:35:47 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-c89158d3-4d51-44eb-ade3-af255792ae77 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments/ceb34956-9137-4101-bf06-c0a761320578" status: 202 len: 0 microversion: 2.1 time: 0.162883 Apr 14 13:35:47 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 362/1085] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:35:47 2023] DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments/ceb34956-9137-4101-bf06-c0a761320578 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:35:47 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:35:47 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:35:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:47 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:47 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-3597f6dd-f3aa-4498-a554-cbffa01593c1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057141 Apr 14 13:35:47 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 358/1086] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:35:47 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:49 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-plugged", "status": "completed", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:49 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Creating event network-vif-plugged:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:35:49 user devstack@n-api.service[61776]: DEBUG nova.compute.api [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61776) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:35:49 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-bb0957cf-24bc-428b-82e6-77dc3e39cbda req-75a3d944-7d66-4cd6-a7ea-1c36997628dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037318 Apr 14 13:35:49 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 367/1087] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:35:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:35:51 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-plugged", "status": "completed", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:35:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:35:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:35:51 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:35:51 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Creating event network-vif-plugged:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:35:51 user devstack@n-api.service[61774]: DEBUG nova.compute.api [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] Instance b64515ec-405b-4d02-9195-3b0efe3b5488 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61774) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 13:35:51 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-03bf8313-8348-4bd2-9bcf-194266c9d18c req-c2838ece-ed90-4a46-99b2-085e51a36098 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036585 Apr 14 13:35:51 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 363/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:35:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:22 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:36:22 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-dd44c704-d5bc-4552-b2e8-d0b51429cf37 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" status: 200 len: 1442 microversion: 2.1 time: 0.258847 Apr 14 13:36:22 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 359/1089] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:36:22 2023] GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => generated 1442 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:36:24 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=12 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:24 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=24 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:24 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1", "tag": "efa8cf9b-10fd-48d5-a01d-160cb930bc07"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:36:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:24 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:24 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] Creating event network-changed:efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 on user Apr 14 13:36:24 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-0640279d-ef33-4c23-b3c4-b399803297ca req-14e1fbad-d656-4516-a494-48256644b216 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039372 Apr 14 13:36:24 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 368/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:36:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=28 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1", "tag": "efa8cf9b-10fd-48d5-a01d-160cb930bc07"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] Creating event network-changed:efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 on user Apr 14 13:36:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-633efae9-614a-4f3e-b729-d6f98a4427a6 req-fa90f096-9f4c-4682-81d4-38f4cb6bdf64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036601 Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:36:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 369/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:36:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:36:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-ab823447-58f9-4d72-ba3e-f7e10389c39b tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" status: 204 len: 0 microversion: 2.1 time: 0.135565 Apr 14 13:36:25 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 360/1092] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:36:25 2023] DELETE /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:36:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-48bfa86a-7f3f-4cbf-bca0-7b0356a61445 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1553 microversion: 2.1 time: 0.376506 Apr 14 13:36:25 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 364/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:36:25 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1553 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:36:25 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:36:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9cab18a9-62da-4bb4-8c04-e2213a5751b0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" status: 200 len: 1566 microversion: 2.1 time: 0.417235 Apr 14 13:36:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 370/1094] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:36:25 2023] GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => generated 1566 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: b7cdf352-a517-4296-bc70-400836915095] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] HTTP exception thrown: Instance b7cdf352-a517-4296-bc70-400836915095 could not be found. Apr 14 13:36:25 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Request method failure captured: Apr 14 13:36:25 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 HTTP/1.1 Apr 14 13:36:25 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:36:25 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:36:25 user devstack@n-api.service[61775]: Connection: close Apr 14 13:36:25 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:36:25 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:36:25 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:36:25 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:36:25 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVI5oc4kA3o0_7I6beMQJ4cetKVQi1aCdbkcA8VjCD63mgZbyHnxEe2hn-Bl_nzwyEM_wn58nCSblLTipzU2RNiXMwY4j5R6hW_Tht6lqDRhR7f_lGSxcrbVvAuPHwO-ya1LKSmflYQqdE1s24Ib0UMzu9y7bqG3U9tkZVGVbJJO1gI Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Project-Id: a573d19b775642bba2f2883e0005492d Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a573d19b775642bba2f2883e0005492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a573d19b775642bba2f2883e0005492d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a573d19b775642bba2f2883e0005492d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Tenant-Id: a573d19b775642bba2f2883e0005492d Apr 14 13:36:25 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:36:25 user devstack@n-api.service[61775]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member Apr 14 13:36:25 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:36:25 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:36:25 user devstack@n-api.service[61775]: X-User-Id: ebc2d46bc1794568841df20b046356c7 Apr 14 13:36:25 user devstack@n-api.service[61775]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member Apr 14 13:36:25 user devstack@n-api.service[61775]: method: > Apr 14 13:36:25 user devstack@n-api.service[61775]: exception: Instance b7cdf352-a517-4296-bc70-400836915095 could not be found. Apr 14 13:36:25 user devstack@n-api.service[61775]: action_args: {'id': 'b7cdf352-a517-4296-bc70-400836915095'} Apr 14 13:36:25 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7cdf352-a517-4296-bc70-400836915095 could not be found. Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7cdf352-a517-4296-bc70-400836915095 could not be found. Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:36:25 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:36:26 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:36:26 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:36:26 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:36:26 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:36:26 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7cdf352-a517-4296-bc70-400836915095 could not be found. Apr 14 13:36:26 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:36:26 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Returning 404 to user: Instance b7cdf352-a517-4296-bc70-400836915095 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:36:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-4a62a7cf-6955-4fc9-b051-7ea3cea5421b tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095" status: 404 len: 111 microversion: 2.87 time: 0.030500 Apr 14 13:36:26 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 361/1095] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:36:25 2023] GET /compute/v2.1/servers/b7cdf352-a517-4296-bc70-400836915095 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:36:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-74de9166-da64-45da-8dc0-ea1ab091a762 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906" status: 204 len: 0 microversion: 2.87 time: 0.131581 Apr 14 13:36:26 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 365/1096] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 13:36:26 2023] DELETE /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:26 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1", "name": "network-vif-unplugged", "status": "completed", "tag": "efa8cf9b-10fd-48d5-a01d-160cb930bc07"}, {"server_uuid": "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1", "name": "network-vif-plugged", "status": "completed", "tag": "efa8cf9b-10fd-48d5-a01d-160cb930bc07"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:36:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:26 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Creating event network-vif-unplugged:efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 on user Apr 14 13:36:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] Creating event network-vif-plugged:efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 on user Apr 14 13:36:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-825fb801-7f53-4e60-9976-e6f9d80fb23c req-b5cc8b93-442c-4036-a432-90b098d8a750 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047637 Apr 14 13:36:26 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 362/1097] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:36:26 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978f6fc8-1080-4840-ab8a-e025efe4f906", "name": "network-vif-unplugged", "status": "completed", "tag": "4c6952bc-e57c-4679-90f3-e9bd66e864ca"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:26 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] Creating event network-vif-unplugged:4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance 978f6fc8-1080-4840-ab8a-e025efe4f906 on user Apr 14 13:36:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-5ef8e3af-4ed0-4db8-84d2-449f70dda7a7 req-7de94f2f-35ea-47ce-af8b-8115ff2bdc45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033918 Apr 14 13:36:26 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 366/1098] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:36:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:36:26 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebc2d46bc1794568841df20b046356c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a573d19b775642bba2f2883e0005492d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:36:26 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-aca302d6-04f7-439e-8f1a-99032dc745cd tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906" status: 200 len: 1696 microversion: 2.87 time: 0.453184 Apr 14 13:36:26 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 371/1099] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:36:26 2023] GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906 => generated 1696 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 13:36:28 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-24b64361-60ad-465a-995d-ac194c3e0af8 req-21142ea9-72b8-41e6-9957-fdf40d454f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1", "name": "network-vif-deleted", "tag": "efa8cf9b-10fd-48d5-a01d-160cb930bc07"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:36:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-24b64361-60ad-465a-995d-ac194c3e0af8 req-21142ea9-72b8-41e6-9957-fdf40d454f9f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-24b64361-60ad-465a-995d-ac194c3e0af8 req-21142ea9-72b8-41e6-9957-fdf40d454f9f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:28 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-24b64361-60ad-465a-995d-ac194c3e0af8 req-21142ea9-72b8-41e6-9957-fdf40d454f9f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:28 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-24b64361-60ad-465a-995d-ac194c3e0af8 req-21142ea9-72b8-41e6-9957-fdf40d454f9f service nova] Creating event network-vif-deleted:efa8cf9b-10fd-48d5-a01d-160cb930bc07 for instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 on user Apr 14 13:36:28 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-24b64361-60ad-465a-995d-ac194c3e0af8 req-21142ea9-72b8-41e6-9957-fdf40d454f9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032544 Apr 14 13:36:28 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 363/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:36:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:36:28 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "978f6fc8-1080-4840-ab8a-e025efe4f906", "name": "network-vif-plugged", "status": "completed", "tag": "4c6952bc-e57c-4679-90f3-e9bd66e864ca"}, {"server_uuid": "978f6fc8-1080-4840-ab8a-e025efe4f906", "name": "network-vif-deleted", "tag": "4c6952bc-e57c-4679-90f3-e9bd66e864ca"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:36:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:28 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Creating event network-vif-plugged:4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance 978f6fc8-1080-4840-ab8a-e025efe4f906 on user Apr 14 13:36:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] Creating event network-vif-deleted:4c6952bc-e57c-4679-90f3-e9bd66e864ca for instance 978f6fc8-1080-4840-ab8a-e025efe4f906 on user Apr 14 13:36:28 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-2775548d-07b1-4eb6-8d9c-89576296c7c6 req-83d86211-e8c6-48e6-aa11-bdba1df113a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031321 Apr 14 13:36:28 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 367/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:36:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=16 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=10 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:37 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:37 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-be114f02-923c-4621-beb8-d541e133d3a2 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.151535 Apr 14 13:36:37 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 372/1102] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:36:37 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 25 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8dba21f-cb8b-4d26-9fef-9c1ee116acf3"}} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:41 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:41 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-f74355ab-aa41-470d-9539-43af277553ef tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428181 Apr 14 13:36:41 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 364/1103] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 13:36:41 2023] POST /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:49 user devstack@n-api.service[61774]: DEBUG nova.objects.instance [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lazy-loading 'services' on Instance uuid 03b76423-23ff-4721-8300-b198286c109a {{(pid=61774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 13:36:50 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ffc09c6f-9277-4bc8-90dc-97c5804fa102 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments/e8dba21f-cb8b-4d26-9fef-9c1ee116acf3" status: 202 len: 0 microversion: 2.1 time: 0.177352 Apr 14 13:36:50 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 368/1104] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 13:36:49 2023] DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments/e8dba21f-cb8b-4d26-9fef-9c1ee116acf3 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:36:50 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:36:50 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-30f9ba03-cc9a-4c8b-94ca-09a3e0b9d0a0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059628 Apr 14 13:36:50 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 373/1105] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:36:50 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:15 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:37:15 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:16 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:37:16 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 HTTP/1.1 Apr 14 13:37:16 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:37:16 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:37:16 user devstack@n-api.service[61775]: Connection: close Apr 14 13:37:16 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:37:16 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:37:16 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:37:16 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:37:16 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:37:16 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:37:16 user devstack@n-api.service[61775]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:37:16 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:37:16 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:37:16 user devstack@n-api.service[61775]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:37:16 user devstack@n-api.service[61775]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:37:16 user devstack@n-api.service[61775]: method: > Apr 14 13:37:16 user devstack@n-api.service[61775]: exception: Instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61775]: action_args: {'id': '5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1'} Apr 14 13:37:16 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:37:16 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-7160567d-a60d-4c38-afbf-b7a99e5c1cd0 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1" status: 404 len: 111 microversion: 2.1 time: 0.153477 Apr 14 13:37:16 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 365/1106] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:37:15 2023] GET /compute/v2.1/servers/5aefeea9-0e2a-4d89-9f3d-c0f3c6e07eb1 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] [instance: 978f6fc8-1080-4840-ab8a-e025efe4f906] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:16 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] HTTP exception thrown: Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Request method failure captured: Apr 14 13:37:16 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906 HTTP/1.1 Apr 14 13:37:16 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:37:16 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:37:16 user devstack@n-api.service[61774]: Connection: close Apr 14 13:37:16 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:37:16 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:37:16 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:37:16 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:37:16 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVI5oc4kA3o0_7I6beMQJ4cetKVQi1aCdbkcA8VjCD63mgZbyHnxEe2hn-Bl_nzwyEM_wn58nCSblLTipzU2RNiXMwY4j5R6hW_Tht6lqDRhR7f_lGSxcrbVvAuPHwO-ya1LKSmflYQqdE1s24Ib0UMzu9y7bqG3U9tkZVGVbJJO1gI Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Project-Id: a573d19b775642bba2f2883e0005492d Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a573d19b775642bba2f2883e0005492d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a573d19b775642bba2f2883e0005492d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a573d19b775642bba2f2883e0005492d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Tenant-Id: a573d19b775642bba2f2883e0005492d Apr 14 13:37:16 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424 Apr 14 13:37:16 user devstack@n-api.service[61774]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member Apr 14 13:37:16 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:37:16 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:37:16 user devstack@n-api.service[61774]: X-User-Id: ebc2d46bc1794568841df20b046356c7 Apr 14 13:37:16 user devstack@n-api.service[61774]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member Apr 14 13:37:16 user devstack@n-api.service[61774]: method: > Apr 14 13:37:16 user devstack@n-api.service[61774]: exception: Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61774]: action_args: {'id': '978f6fc8-1080-4840-ab8a-e025efe4f906'} Apr 14 13:37:16 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 could not be found. Apr 14 13:37:16 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:37:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] Returning 404 to user: Instance 978f6fc8-1080-4840-ab8a-e025efe4f906 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:37:16 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-4b15ca38-da90-4715-88d6-003233935f89 tempest-ServerBootFromVolumeStableRescueTest-740277424 tempest-ServerBootFromVolumeStableRescueTest-740277424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906" status: 404 len: 111 microversion: 2.87 time: 0.038501 Apr 14 13:37:16 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 369/1107] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 13:37:16 2023] GET /compute/v2.1/servers/978f6fc8-1080-4840-ab8a-e025efe4f906 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 13:37:21 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:37:21 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:37:21 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-b6295d5d-e305-42e2-aa50-d1de3332d320 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Action: 'create', calling method: .version_select at 0x7fa743c21480>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-175276604", "metadata": {"Type": "work"}}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:37:21 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-b6295d5d-e305-42e2-aa50-d1de3332d320 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.618463 Apr 14 13:37:21 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 374/1108] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 13:37:21 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 620 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 13:37:21 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-643bd311-9da4-4664-9d6e-7bf6ad42a97b tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa74397b010>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:21 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-643bd311-9da4-4664-9d6e-7bf6ad42a97b tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 200 len: 352 microversion: 2.1 time: 0.060147 Apr 14 13:37:21 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 366/1109] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:37:21 2023] GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:22 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-a0328232-28d4-4026-975a-6a381f29b26e tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa7437bd2d0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:22 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-a0328232-28d4-4026-975a-6a381f29b26e tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 200 len: 352 microversion: 2.1 time: 0.061040 Apr 14 13:37:22 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 370/1110] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:37:22 2023] GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:37:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f323dce-be29-4437-8992-4bfec3ba29ab", "tag": "a23e9593-5778-4287-890a-07585622bc27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:23 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] Creating event network-changed:a23e9593-5778-4287-890a-07585622bc27 for instance 5f323dce-be29-4437-8992-4bfec3ba29ab on user Apr 14 13:37:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-40e69342-0a3c-4d6e-bb32-1c7775168bc6 req-b0cd60ba-92e9-44b2-ab39-939c97ddbcf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030078 Apr 14 13:37:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 367/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:37:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:37:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-5bb879d7-62a8-4042-8760-914e3bbc43c8 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab" status: 204 len: 0 microversion: 2.1 time: 0.125152 Apr 14 13:37:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 375/1112] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:37:23 2023] DELETE /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb40413bd0c3490d97b997f69c930f72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818de6fa330c4c87a3b6228345d9f13a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:37:23 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-8a56cb36-6cdf-4a1b-8dfd-497e74213b47 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab" status: 200 len: 1568 microversion: 2.1 time: 0.432695 Apr 14 13:37:23 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 371/1113] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:37:23 2023] GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab => generated 1568 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:37:23 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-2dd5d0b3-eb37-4c58-8dd1-244dae9a5460 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa743978790>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:23 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-2dd5d0b3-eb37-4c58-8dd1-244dae9a5460 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 200 len: 353 microversion: 2.1 time: 0.072699 Apr 14 13:37:23 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 368/1114] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:37:23 2023] GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:23 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-44d1f47c-02ec-4827-bc71-ad54e0c9185e tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa743d06680>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:23 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-44d1f47c-02ec-4827-bc71-ad54e0c9185e tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 200 len: 353 microversion: 2.1 time: 0.058257 Apr 14 13:37:23 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 376/1115] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:37:23 2023] GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:23 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-b4855961-254e-4260-9d64-79c4fdadaa6a tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa743a82950>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:24 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-b4855961-254e-4260-9d64-79c4fdadaa6a tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 202 len: 0 microversion: 2.1 time: 0.068719 Apr 14 13:37:24 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 372/1116] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 13:37:23 2023] DELETE /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:37:24 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-44593a5e-cb9a-4a46-b3a2-21233afcb582 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa7439a3880>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:24 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-44593a5e-cb9a-4a46-b3a2-21233afcb582 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 200 len: 352 microversion: 2.1 time: 0.062417 Apr 14 13:37:24 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 369/1117] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:37:24 2023] GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f323dce-be29-4437-8992-4bfec3ba29ab", "name": "network-vif-deleted", "tag": "a23e9593-5778-4287-890a-07585622bc27"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] Creating event network-vif-deleted:a23e9593-5778-4287-890a-07585622bc27 for instance 5f323dce-be29-4437-8992-4bfec3ba29ab on user Apr 14 13:37:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-4ae8a1a8-5096-4ebd-8f6a-e8c6c7c18ed7 req-556c004a-10ed-4479-a15f-e089177f066e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027964 Apr 14 13:37:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 377/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:37:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-62132f7c-a0a5-4c3c-9868-2b745963ad2a tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa743a832e0>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:25 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-62132f7c-a0a5-4c3c-9868-2b745963ad2a tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 200 len: 352 microversion: 2.1 time: 0.058634 Apr 14 13:37:25 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 373/1119] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:37:25 2023] GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:25 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f323dce-be29-4437-8992-4bfec3ba29ab", "name": "network-vif-unplugged", "status": "completed", "tag": "a23e9593-5778-4287-890a-07585622bc27"}, {"server_uuid": "5f323dce-be29-4437-8992-4bfec3ba29ab", "name": "network-vif-plugged", "status": "completed", "tag": "a23e9593-5778-4287-890a-07585622bc27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:37:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:25 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Creating event network-vif-unplugged:a23e9593-5778-4287-890a-07585622bc27 for instance 5f323dce-be29-4437-8992-4bfec3ba29ab on user Apr 14 13:37:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] Creating event network-vif-plugged:a23e9593-5778-4287-890a-07585622bc27 for instance 5f323dce-be29-4437-8992-4bfec3ba29ab on user Apr 14 13:37:25 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-d7afeb70-2d87-48f9-aab1-b341549e739f req-ef370439-9e66-4c81-bb04-75d8900ebbba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.048984 Apr 14 13:37:25 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 370/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:37:25 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:25 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:25 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-a2b944e3-b265-4cec-aa71-630abc5e8de0 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488/action" status: 204 len: 0 microversion: 2.1 time: 0.072765 Apr 14 13:37:25 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 378/1121] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:37:25 2023] POST /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:25 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:26 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-dce80c83-2df4-479c-bd6a-cd7d2649a195 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa74397b520>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:26 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:37:26 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-36f480dd-d282-4075-8d4e-a4fe7bb49fee tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1553 microversion: 2.1 time: 0.237636 Apr 14 13:37:26 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 374/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:37:25 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:37:26 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-dce80c83-2df4-479c-bd6a-cd7d2649a195 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 200 len: 352 microversion: 2.1 time: 0.053464 Apr 14 13:37:26 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 371/1123] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:37:26 2023] GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:37:27 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-79f20d63-f074-4305-ae1d-3379fe0a8bd4 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Calling method '.version_select at 0x7fa743c229e0>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:27 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-79f20d63-f074-4305-ae1d-3379fe0a8bd4 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] HTTP exception thrown: Volume 644fe617-de35-41ea-a720-4f6e1070b05a could not be found. Apr 14 13:37:27 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-79f20d63-f074-4305-ae1d-3379fe0a8bd4 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Request method failure captured: Apr 14 13:37:27 user devstack@n-api.service[61776]: request: GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a HTTP/1.1 Apr 14 13:37:27 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:37:27 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:37:27 user devstack@n-api.service[61776]: Connection: close Apr 14 13:37:27 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:37:27 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:37:27 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:37:27 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:37:27 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVcQznXiuSW1H7QGBBZqK6W9AkdyOxE81VdgE0AB5-D2uLxAGHIQuA9G7TC8TdBHZJHoSF-11pcfGC04oMs867TDf0aANgHHjhG-tlBTA_KRROGglRblFw1fY3fih0mtdcwq_od3WZwQuOrA_DUzv6et30QXQjEdG1VrewqDvC8tgUE Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Project-Id: a9ee63e8fadf4f388e3fb633b044952a Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Project-Name: tempest-VolumesGetTestJSON-2082777451 Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a9ee63e8fadf4f388e3fb633b044952a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a9ee63e8fadf4f388e3fb633b044952a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a9ee63e8fadf4f388e3fb633b044952a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Tenant: tempest-VolumesGetTestJSON-2082777451 Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Tenant-Id: a9ee63e8fadf4f388e3fb633b044952a Apr 14 13:37:27 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-VolumesGetTestJSON-2082777451 Apr 14 13:37:27 user devstack@n-api.service[61776]: X-User: tempest-VolumesGetTestJSON-2082777451-project-member Apr 14 13:37:27 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:37:27 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:37:27 user devstack@n-api.service[61776]: X-User-Id: 2826e4e82d7b486aa561e1fcef319993 Apr 14 13:37:27 user devstack@n-api.service[61776]: X-User-Name: tempest-VolumesGetTestJSON-2082777451-project-member Apr 14 13:37:27 user devstack@n-api.service[61776]: method: Apr 14 13:37:27 user devstack@n-api.service[61776]: exception: Volume 644fe617-de35-41ea-a720-4f6e1070b05a could not be found. Apr 14 13:37:27 user devstack@n-api.service[61776]: action_args: {'id': '644fe617-de35-41ea-a720-4f6e1070b05a'} Apr 14 13:37:27 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 644fe617-de35-41ea-a720-4f6e1070b05a could not be found. (HTTP 404) (Request-ID: req-36f61e67-74b5-4716-ac71-79712deafe42) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 644fe617-de35-41ea-a720-4f6e1070b05a could not be found. Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 644fe617-de35-41ea-a720-4f6e1070b05a could not be found. Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 644fe617-de35-41ea-a720-4f6e1070b05a could not be found. Apr 14 13:37:27 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:37:27 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-79f20d63-f074-4305-ae1d-3379fe0a8bd4 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] Returning 404 to user: Volume 644fe617-de35-41ea-a720-4f6e1070b05a could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:37:27 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-79f20d63-f074-4305-ae1d-3379fe0a8bd4 tempest-VolumesGetTestJSON-2082777451 tempest-VolumesGetTestJSON-2082777451-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a" status: 404 len: 109 microversion: 2.1 time: 0.058754 Apr 14 13:37:27 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 379/1124] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 13:37:27 2023] GET /compute/v2.1/os-volumes/644fe617-de35-41ea-a720-4f6e1070b05a => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=14 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:37:40 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:37:40 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-ff2b8f9f-5c3c-4c03-9ce2-c610462ce7d1 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059767 Apr 14 13:37:40 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 375/1125] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 13:37:40 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 13:38:00 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:00 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:00 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b76423-23ff-4721-8300-b198286c109a", "tag": "5670a4df-018a-4b12-bf37-a1fada7bfe9e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:38:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:00 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:00 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] Creating event network-changed:5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance 03b76423-23ff-4721-8300-b198286c109a on user Apr 14 13:38:00 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-04f3bec1-721b-4954-8b9e-ee0aea7c2928 req-31b2fb4d-03ce-4a00-b661-f4d03e4093d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046759 Apr 14 13:38:00 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 372/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:38:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:03 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Going to try to terminate instance {{(pid=61776) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:38:04 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-fbbc888c-e752-4ffb-95ea-a9b4e9ce4bf0 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a" status: 204 len: 0 microversion: 2.1 time: 0.171720 Apr 14 13:38:04 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 380/1127] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:38:03 2023] DELETE /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:04 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b76423-23ff-4721-8300-b198286c109a", "name": "network-vif-unplugged", "status": "completed", "tag": "5670a4df-018a-4b12-bf37-a1fada7bfe9e"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:38:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:04 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:04 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] Creating event network-vif-unplugged:5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance 03b76423-23ff-4721-8300-b198286c109a on user Apr 14 13:38:04 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-e2eaaa09-9cc8-438e-9c0d-eedd086d365a req-6ca1f5af-657d-4484-b900-efa32d541b9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032391 Apr 14 13:38:04 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 373/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:38:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:38:04 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '140e52ed81ba492abc14653240501497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad49f75bbe9461b936963e8dc6c8be5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:38:04 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9a919ee9-d3d3-49a2-8577-e7aa9f713a46 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a" status: 200 len: 1573 microversion: 2.1 time: 0.512996 Apr 14 13:38:04 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 376/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:38:04 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a => generated 1573 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:38:06 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b76423-23ff-4721-8300-b198286c109a", "name": "network-vif-plugged", "status": "completed", "tag": "5670a4df-018a-4b12-bf37-a1fada7bfe9e"}, {"server_uuid": "03b76423-23ff-4721-8300-b198286c109a", "name": "network-vif-deleted", "tag": "5670a4df-018a-4b12-bf37-a1fada7bfe9e"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:38:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:06 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Creating event network-vif-plugged:5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance 03b76423-23ff-4721-8300-b198286c109a on user Apr 14 13:38:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] Creating event network-vif-deleted:5670a4df-018a-4b12-bf37-a1fada7bfe9e for instance 03b76423-23ff-4721-8300-b198286c109a on user Apr 14 13:38:06 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-502b28cb-9b16-4107-ae8c-d00071edcdd3 req-88e5b81f-a312-4cba-86ca-72fc303ade5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032173 Apr 14 13:38:06 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 381/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:38:06 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 5f323dce-be29-4437-8992-4bfec3ba29ab] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 5f323dce-be29-4437-8992-4bfec3ba29ab could not be found. Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:38:13 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab HTTP/1.1 Apr 14 13:38:13 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:38:13 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:38:13 user devstack@n-api.service[61775]: Connection: close Apr 14 13:38:13 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:38:13 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:38:13 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:38:13 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:38:13 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:38:13 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:13 user devstack@n-api.service[61775]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:38:13 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:38:13 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:38:13 user devstack@n-api.service[61775]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:38:13 user devstack@n-api.service[61775]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:38:13 user devstack@n-api.service[61775]: method: > Apr 14 13:38:13 user devstack@n-api.service[61775]: exception: Instance 5f323dce-be29-4437-8992-4bfec3ba29ab could not be found. Apr 14 13:38:13 user devstack@n-api.service[61775]: action_args: {'id': '5f323dce-be29-4437-8992-4bfec3ba29ab'} Apr 14 13:38:13 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f323dce-be29-4437-8992-4bfec3ba29ab could not be found. Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f323dce-be29-4437-8992-4bfec3ba29ab could not be found. Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f323dce-be29-4437-8992-4bfec3ba29ab could not be found. Apr 14 13:38:13 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:38:13 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 5f323dce-be29-4437-8992-4bfec3ba29ab could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:38:13 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-5ac3d168-9765-412f-977f-7c396233c4ac tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab" status: 404 len: 111 microversion: 2.1 time: 0.033998 Apr 14 13:38:13 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 374/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:38:13 2023] GET /compute/v2.1/servers/5f323dce-be29-4437-8992-4bfec3ba29ab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:38:14 user devstack@n-api.service[61774]: request: DELETE /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d HTTP/1.1 Apr 14 13:38:14 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:38:14 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:38:14 user devstack@n-api.service[61774]: Connection: close Apr 14 13:38:14 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:38:14 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:38:14 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:38:14 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:38:14 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:38:14 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:14 user devstack@n-api.service[61774]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:38:14 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:38:14 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:38:14 user devstack@n-api.service[61774]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:38:14 user devstack@n-api.service[61774]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:38:14 user devstack@n-api.service[61774]: method: > Apr 14 13:38:14 user devstack@n-api.service[61774]: exception: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61774]: action_args: {'id': '167e06f3-4a3d-418d-8aaa-4827c749258d'} Apr 14 13:38:14 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:38:14 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-6be87aca-c081-4b05-97cb-a1a83bb4dae4 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d" status: 404 len: 111 microversion: 2.1 time: 0.030127 Apr 14 13:38:14 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 377/1132] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:38:14 2023] DELETE /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] [instance: 167e06f3-4a3d-418d-8aaa-4827c749258d] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] HTTP exception thrown: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Request method failure captured: Apr 14 13:38:14 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d HTTP/1.1 Apr 14 13:38:14 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:38:14 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:38:14 user devstack@n-api.service[61776]: Connection: close Apr 14 13:38:14 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:38:14 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:38:14 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:38:14 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:38:14 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVM5Kag8hoJgGRpJ4Ffug8yLxqZ927KdLK62nSv8c7bzSua7Mk0M-WXt69v9ImlttGdWOEZJQwFLVjEPawX1vnO5sEgx0_78ry2ar95H-ObxZ3V0JRN9_CajtcnrgesXc4RMNVsaFh2W3XvBqwC_Fb79D52Av_t6YEHocq7JODvQl1Q Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Project-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Project-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/818de6fa330c4c87a3b6228345d9f13a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Tenant: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Tenant-Id: 818de6fa330c4c87a3b6228345d9f13a Apr 14 13:38:14 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645546988 Apr 14 13:38:14 user devstack@n-api.service[61776]: X-User: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:38:14 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:38:14 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:38:14 user devstack@n-api.service[61776]: X-User-Id: bb40413bd0c3490d97b997f69c930f72 Apr 14 13:38:14 user devstack@n-api.service[61776]: X-User-Name: tempest-TestVolumeBootPattern-1645546988-project-member Apr 14 13:38:14 user devstack@n-api.service[61776]: method: > Apr 14 13:38:14 user devstack@n-api.service[61776]: exception: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61776]: action_args: {'id': '167e06f3-4a3d-418d-8aaa-4827c749258d'} Apr 14 13:38:14 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. Apr 14 13:38:14 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:14 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Returning 404 to user: Instance 167e06f3-4a3d-418d-8aaa-4827c749258d could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:38:14 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-c792627b-6cbb-4eda-be51-a7ae3d3a4efc tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d" status: 404 len: 111 microversion: 2.1 time: 0.029389 Apr 14 13:38:14 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 382/1133] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:38:14 2023] GET /compute/v2.1/servers/167e06f3-4a3d-418d-8aaa-4827c749258d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:16 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:38:16 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-f59e6548-9c4b-43c7-a650-60614ef6e5a6 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1545 microversion: 2.1 time: 0.359139 Apr 14 13:38:16 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 375/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:38:16 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1545 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:38:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-9ce26053-6ed0-4164-bf41-096dbba19a77 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] Calling method '.version_select at 0x7fa743a83e20>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-9ce26053-6ed0-4164-bf41-096dbba19a77 tempest-TestVolumeBootPattern-1645546988 tempest-TestVolumeBootPattern-1645546988-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-212867192" status: 202 len: 0 microversion: 2.1 time: 0.024239 Apr 14 13:38:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 378/1135] 10.0.0.210 () {62 vars in 1337 bytes} [Fri Apr 14 13:38:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-212867192 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR oslo.messaging._drivers.impl_rabbit [-] [51f54b2e-fe6c-4828-b8db-b93d530f7d03] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] [instance: 03b76423-23ff-4721-8300-b198286c109a] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:38:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] HTTP exception thrown: Instance 03b76423-23ff-4721-8300-b198286c109a could not be found. Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Request method failure captured: Apr 14 13:38:54 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a HTTP/1.1 Apr 14 13:38:54 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:38:54 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:38:54 user devstack@n-api.service[61776]: Connection: close Apr 14 13:38:54 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:38:54 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:38:54 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:38:54 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:38:54 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVWh1zKW5Tg3LjciDAz-f5sR3kuzdpJxbD0UrBHHJ8RYh9hq-RP0ZPAnyR_lCA9cG-h92Hbyao8k8O7aSeb1mpjSQh7Im1Va-gDhJYrzPkl20lgJbTqWQs960o39ec9nJNKt80kiiAnNPGfgzYn-oZGeU-DrnHiQ_Phcr0OtRYuFQcw Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Project-Id: 0ad49f75bbe9461b936963e8dc6c8be5 Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1133806652 Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0ad49f75bbe9461b936963e8dc6c8be5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ad49f75bbe9461b936963e8dc6c8be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0ad49f75bbe9461b936963e8dc6c8be5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Tenant: tempest-SnapshotDataIntegrityTests-1133806652 Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Tenant-Id: 0ad49f75bbe9461b936963e8dc6c8be5 Apr 14 13:38:54 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1133806652 Apr 14 13:38:54 user devstack@n-api.service[61776]: X-User: tempest-SnapshotDataIntegrityTests-1133806652-project-member Apr 14 13:38:54 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:38:54 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:38:54 user devstack@n-api.service[61776]: X-User-Id: 140e52ed81ba492abc14653240501497 Apr 14 13:38:54 user devstack@n-api.service[61776]: X-User-Name: tempest-SnapshotDataIntegrityTests-1133806652-project-member Apr 14 13:38:54 user devstack@n-api.service[61776]: method: > Apr 14 13:38:54 user devstack@n-api.service[61776]: exception: Instance 03b76423-23ff-4721-8300-b198286c109a could not be found. Apr 14 13:38:54 user devstack@n-api.service[61776]: action_args: {'id': '03b76423-23ff-4721-8300-b198286c109a'} Apr 14 13:38:54 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b76423-23ff-4721-8300-b198286c109a could not be found. Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b76423-23ff-4721-8300-b198286c109a could not be found. Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b76423-23ff-4721-8300-b198286c109a could not be found. Apr 14 13:38:54 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:38:54 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Returning 404 to user: Instance 03b76423-23ff-4721-8300-b198286c109a could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:38:54 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-9c5ce3c4-6a26-42bc-8e07-be4141ec95e4 tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a" status: 404 len: 111 microversion: 2.1 time: 0.047878 Apr 14 13:38:54 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 383/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:38:54 2023] GET /compute/v2.1/servers/03b76423-23ff-4721-8300-b198286c109a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:38:54 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=8 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:54 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=12 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:38:54 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a3dee3c9-11f1-4543-9287-4eb79b010d6d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] Calling method '.version_select at 0x7fa743ecacb0>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:38:54 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a3dee3c9-11f1-4543-9287-4eb79b010d6d tempest-SnapshotDataIntegrityTests-1133806652 tempest-SnapshotDataIntegrityTests-1133806652-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-495571124" status: 202 len: 0 microversion: 2.1 time: 0.032901 Apr 14 13:38:54 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 376/1137] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 13:38:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-495571124 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=8 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:39:16 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:39:17 user devstack@n-api.service[61774]: DEBUG nova.policy [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61774) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:39:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-acb2b3dd-4346-425f-8b2c-30327523e9ab tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1545 microversion: 2.1 time: 0.482676 Apr 14 13:39:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 379/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:39:16 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1545 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:39:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:39:17 user devstack@n-api.service[61776]: INFO oslo.messaging._drivers.impl_rabbit [-] [51f54b2e-fe6c-4828-b8db-b93d530f7d03] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47098. Apr 14 13:39:17 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-7bcf6787-bdc6-4a45-b854-9a7ac0cbb09f tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488/action" status: 200 len: 28254 microversion: 2.1 time: 0.279703 Apr 14 13:39:17 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 384/1139] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 13:39:17 2023] POST /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488/action => generated 28254 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:39:17 user devstack@n-api.service[61775]: DEBUG nova.policy [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61775) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:39:17 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-a2baf6ca-8ffb-4e58-b707-502bc9bdd912 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227" status: 200 len: 1537 microversion: 2.1 time: 0.235722 Apr 14 13:39:17 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 377/1140] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:39:17 2023] GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=2 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=6 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:40:17 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Going to try to terminate instance {{(pid=61774) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:40:17 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-59a4b4a4-cebc-4169-9d01-58f53b80f280 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 204 len: 0 microversion: 2.1 time: 0.124357 Apr 14 13:40:17 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 380/1141] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:40:17 2023] DELETE /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=4 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:40:17 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:40:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:40:18 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=6 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:40:18 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-unplugged", "status": "completed", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:40:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:40:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:40:18 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:40:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] Creating event network-vif-unplugged:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:40:18 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-0532bde0-63b9-4211-8420-7fdef6ca12f9 req-ce067ce0-4ed4-433f-a6c6-78b2f4e64b59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103043 Apr 14 13:40:18 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 378/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:40:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:40:18 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:40:18 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-d4acbc9c-0d3b-41de-b320-6ccd6095ccd9 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 200 len: 1551 microversion: 2.1 time: 0.552494 Apr 14 13:40:18 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 385/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:40:17 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 1551 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:40:20 user devstack@n-api.service[61774]: ERROR oslo.messaging._drivers.impl_rabbit [-] [19642058-e45a-4d89-8792-b9b57eb0793d] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 13:40:20 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-plugged", "status": "completed", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}, {"server_uuid": "b64515ec-405b-4d02-9195-3b0efe3b5488", "name": "network-vif-deleted", "tag": "c7944161-7d6c-4fa8-b0b9-a6e2e3c23203"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:40:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:40:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:40:20 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:40:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Creating event network-vif-plugged:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:40:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] Creating event network-vif-deleted:c7944161-7d6c-4fa8-b0b9-a6e2e3c23203 for instance b64515ec-405b-4d02-9195-3b0efe3b5488 on user Apr 14 13:40:20 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-168b066c-409a-43ef-8452-05982221744d req-2a481e4a-8666-4d15-9419-21db0ff5ec90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033632 Apr 14 13:40:20 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 381/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:40:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=2 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:41:08 user devstack@n-api.service[61775]: request: GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 HTTP/1.1 Apr 14 13:41:08 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:41:08 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:41:08 user devstack@n-api.service[61775]: Connection: close Apr 14 13:41:08 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:41:08 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:41:08 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:41:08 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:41:08 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:41:08 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61775]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:41:08 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:41:08 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:41:08 user devstack@n-api.service[61775]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:41:08 user devstack@n-api.service[61775]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:41:08 user devstack@n-api.service[61775]: method: > Apr 14 13:41:08 user devstack@n-api.service[61775]: exception: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61775]: action_args: {'id': 'b64515ec-405b-4d02-9195-3b0efe3b5488'} Apr 14 13:41:08 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:41:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-faf37ada-8be7-4422-8bf6-2308f6429727 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 404 len: 111 microversion: 2.1 time: 0.037926 Apr 14 13:41:08 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 379/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:41:08 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=2 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:41:08 user devstack@n-api.service[61776]: request: DELETE /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 HTTP/1.1 Apr 14 13:41:08 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:41:08 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:41:08 user devstack@n-api.service[61776]: Connection: close Apr 14 13:41:08 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:41:08 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:41:08 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:41:08 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:41:08 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:41:08 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61776]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:41:08 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:41:08 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:41:08 user devstack@n-api.service[61776]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:41:08 user devstack@n-api.service[61776]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:41:08 user devstack@n-api.service[61776]: method: > Apr 14 13:41:08 user devstack@n-api.service[61776]: exception: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61776]: action_args: {'id': 'b64515ec-405b-4d02-9195-3b0efe3b5488'} Apr 14 13:41:08 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:41:08 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-6d8cf427-6b18-414d-9388-c2d2932a8ec3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 404 len: 111 microversion: 2.1 time: 0.033681 Apr 14 13:41:08 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 386/1146] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:41:08 2023] DELETE /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: b64515ec-405b-4d02-9195-3b0efe3b5488] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61774]: INFO oslo.messaging._drivers.impl_rabbit [-] [19642058-e45a-4d89-8792-b9b57eb0793d] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 36616. Apr 14 13:41:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:41:08 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 HTTP/1.1 Apr 14 13:41:08 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:41:08 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:41:08 user devstack@n-api.service[61774]: Connection: close Apr 14 13:41:08 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:41:08 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:41:08 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:41:08 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:41:08 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:41:08 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:08 user devstack@n-api.service[61774]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:41:08 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:41:08 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:41:08 user devstack@n-api.service[61774]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:41:08 user devstack@n-api.service[61774]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:41:08 user devstack@n-api.service[61774]: method: > Apr 14 13:41:08 user devstack@n-api.service[61774]: exception: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61774]: action_args: {'id': 'b64515ec-405b-4d02-9195-3b0efe3b5488'} Apr 14 13:41:08 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. Apr 14 13:41:08 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:08 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance b64515ec-405b-4d02-9195-3b0efe3b5488 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:41:08 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-64501b46-a8a7-4dc0-84d5-8270b3c12204 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488" status: 404 len: 111 microversion: 2.1 time: 0.045127 Apr 14 13:41:08 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 382/1147] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:41:08 2023] GET /compute/v2.1/servers/b64515ec-405b-4d02-9195-3b0efe3b5488 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Going to try to terminate instance {{(pid=61775) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 13:41:08 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-6c07354d-b77a-4198-b08d-9f0794808802 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227" status: 204 len: 0 microversion: 2.1 time: 0.119482 Apr 14 13:41:08 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 380/1148] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:41:08 2023] DELETE /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:08 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:09 user devstack@n-api.service[61776]: DEBUG nova.policy [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9169729edbd04fd5a74d2cffd0aa437f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b197f1df57f4dee9757639cf861eb97', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61776) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 13:41:09 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-2826f794-ff9d-43c5-aa17-3afc66918b59 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227" status: 200 len: 1543 microversion: 2.1 time: 0.251131 Apr 14 13:41:09 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 387/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:41:08 2023] GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227 => generated 1543 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 13:41:09 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe769254-aa7a-4038-abb6-18628dbcd227", "name": "network-vif-unplugged", "status": "completed", "tag": "08aca6e2-fbdf-43c4-878a-45558c029e27"}]} {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:41:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:09 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:09 user devstack@n-api.service[61774]: INFO nova.api.openstack.compute.server_external_events [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] Creating event network-vif-unplugged:08aca6e2-fbdf-43c4-878a-45558c029e27 for instance fe769254-aa7a-4038-abb6-18628dbcd227 on user Apr 14 13:41:09 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [req-2ccc391f-6048-4b74-b8f6-440bf74837cb req-957155f3-dea5-4828-9449-3e71f0452765 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081649 Apr 14 13:41:09 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 383/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:41:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:41:10 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe769254-aa7a-4038-abb6-18628dbcd227", "name": "network-vif-deleted", "tag": "08aca6e2-fbdf-43c4-878a-45558c029e27"}]} {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:41:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:10 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.compute.server_external_events [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] Creating event network-vif-deleted:08aca6e2-fbdf-43c4-878a-45558c029e27 for instance fe769254-aa7a-4038-abb6-18628dbcd227 on user Apr 14 13:41:10 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [req-cd687f3c-09a0-41a4-8530-107b2f2eecc7 req-80670636-13d4-4512-a2eb-9a7acf0a6e79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030829 Apr 14 13:41:10 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 381/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:41:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:41:11 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe769254-aa7a-4038-abb6-18628dbcd227", "name": "network-vif-plugged", "status": "completed", "tag": "08aca6e2-fbdf-43c4-878a-45558c029e27"}]} {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 13:41:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:11 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:11 user devstack@n-api.service[61776]: INFO nova.api.openstack.compute.server_external_events [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] Creating event network-vif-plugged:08aca6e2-fbdf-43c4-878a-45558c029e27 for instance fe769254-aa7a-4038-abb6-18628dbcd227 on user Apr 14 13:41:11 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [req-8c3bf2f6-9e56-40bd-b651-5bbff2b1d73f req-edcd1ec7-5c32-4cee-af92-8e7a5ae1b2a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030562 Apr 14 13:41:11 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 388/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 13:41:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_api:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG dbcounter [-] [61774] Writing DB stats nova_cell1:SELECT=4 {{(pid=61774) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:41:59 user devstack@n-api.service[61774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 13:41:59 user devstack@n-api.service[61774]: Fri Apr 14 13:41:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227 (ip 10.0.0.210) !!! Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG nova.compute.api [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: fe769254-aa7a-4038-abb6-18628dbcd227] Fetching instance by UUID {{(pid=61774) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG oslo_concurrency.lockutils [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61774) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:41:59 user devstack@n-api.service[61774]: INFO nova.api.openstack.wsgi [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance fe769254-aa7a-4038-abb6-18628dbcd227 could not be found. Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:41:59 user devstack@n-api.service[61774]: request: GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227 HTTP/1.1 Apr 14 13:41:59 user devstack@n-api.service[61774]: Accept: application/json Apr 14 13:41:59 user devstack@n-api.service[61774]: Accept-Encoding: identity Apr 14 13:41:59 user devstack@n-api.service[61774]: Connection: close Apr 14 13:41:59 user devstack@n-api.service[61774]: Content-Length: 0 Apr 14 13:41:59 user devstack@n-api.service[61774]: Content-Type: application/json Apr 14 13:41:59 user devstack@n-api.service[61774]: Host: 10.0.0.210 Apr 14 13:41:59 user devstack@n-api.service[61774]: Openstack-System-Scope: None Apr 14 13:41:59 user devstack@n-api.service[61774]: User-Agent: python-urllib3/1.26.15 Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Domain-Id: None Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Domain-Name: None Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Identity-Status: Confirmed Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Is-Admin-Project: True Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Project-Domain-Id: default Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Project-Domain-Name: Default Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Role: reader,member Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Roles: reader,member Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:41:59 user devstack@n-api.service[61774]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:41:59 user devstack@n-api.service[61774]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:41:59 user devstack@n-api.service[61774]: X-User-Domain-Id: default Apr 14 13:41:59 user devstack@n-api.service[61774]: X-User-Domain-Name: Default Apr 14 13:41:59 user devstack@n-api.service[61774]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:41:59 user devstack@n-api.service[61774]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:41:59 user devstack@n-api.service[61774]: method: > Apr 14 13:41:59 user devstack@n-api.service[61774]: exception: Instance fe769254-aa7a-4038-abb6-18628dbcd227 could not be found. Apr 14 13:41:59 user devstack@n-api.service[61774]: action_args: {'id': 'fe769254-aa7a-4038-abb6-18628dbcd227'} Apr 14 13:41:59 user devstack@n-api.service[61774]: {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe769254-aa7a-4038-abb6-18628dbcd227 could not be found. Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe769254-aa7a-4038-abb6-18628dbcd227 could not be found. Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe769254-aa7a-4038-abb6-18628dbcd227 could not be found. Apr 14 13:41:59 user devstack@n-api.service[61774]: ERROR nova.api.openstack.wsgi Apr 14 13:41:59 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance fe769254-aa7a-4038-abb6-18628dbcd227 could not be found. {{(pid=61774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:41:59 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-55fa4aee-a63f-4e14-ac13-a2cf68f7fe19 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227" status: 404 len: 111 microversion: 2.1 time: 0.040563 Apr 14 13:41:59 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 384/1153] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:41:59 2023] GET /compute/v2.1/servers/fe769254-aa7a-4038-abb6-18628dbcd227 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR oslo.messaging._drivers.impl_rabbit [-] [79f23f15-c496-4de2-8655-0502087b0b22] AMQP server on 10.0.0.210:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG dbcounter [-] [61775] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61775) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:42:05 user devstack@n-api.service[61775]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 13:42:05 user devstack@n-api.service[61775]: Fri Apr 14 13:42:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 (ip 10.0.0.210) !!! Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG nova.compute.api [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61775) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG oslo_concurrency.lockutils [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61775) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:42:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.wsgi [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:42:05 user devstack@n-api.service[61775]: request: DELETE /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 HTTP/1.1 Apr 14 13:42:05 user devstack@n-api.service[61775]: Accept: application/json Apr 14 13:42:05 user devstack@n-api.service[61775]: Accept-Encoding: identity Apr 14 13:42:05 user devstack@n-api.service[61775]: Connection: close Apr 14 13:42:05 user devstack@n-api.service[61775]: Content-Length: 0 Apr 14 13:42:05 user devstack@n-api.service[61775]: Content-Type: application/json Apr 14 13:42:05 user devstack@n-api.service[61775]: Host: 10.0.0.210 Apr 14 13:42:05 user devstack@n-api.service[61775]: Openstack-System-Scope: None Apr 14 13:42:05 user devstack@n-api.service[61775]: User-Agent: python-urllib3/1.26.15 Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Domain-Id: None Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Domain-Name: None Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Identity-Status: Confirmed Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Is-Admin-Project: True Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Project-Domain-Id: default Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Project-Domain-Name: Default Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Role: reader,member Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Roles: reader,member Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:42:05 user devstack@n-api.service[61775]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:42:05 user devstack@n-api.service[61775]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:42:05 user devstack@n-api.service[61775]: X-User-Domain-Id: default Apr 14 13:42:05 user devstack@n-api.service[61775]: X-User-Domain-Name: Default Apr 14 13:42:05 user devstack@n-api.service[61775]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:42:05 user devstack@n-api.service[61775]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:42:05 user devstack@n-api.service[61775]: method: > Apr 14 13:42:05 user devstack@n-api.service[61775]: exception: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61775]: action_args: {'id': '6e646c88-579e-4ea1-b987-da1c7194a064'} Apr 14 13:42:05 user devstack@n-api.service[61775]: {{(pid=61775) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61775]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61775]: DEBUG nova.api.openstack.wsgi [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. {{(pid=61775) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:42:05 user devstack@n-api.service[61775]: INFO nova.api.openstack.requestlog [None req-1b14073f-138f-4e57-b3ce-8de6c5f03eb3 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 404 len: 111 microversion: 2.1 time: 0.055051 Apr 14 13:42:05 user devstack@n-api.service[61775]: [pid: 61775|app: 0|req: 382/1154] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 13:42:05 2023] DELETE /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '>' {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG nova.compute.api [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] [instance: 6e646c88-579e-4ea1-b987-da1c7194a064] Fetching instance by UUID {{(pid=61776) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_api:SELECT=6 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG dbcounter [-] [61776] Writing DB stats nova_cell1:SELECT=10 {{(pid=61776) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Acquiring lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG oslo_concurrency.lockutils [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Lock "45b69ebb-541a-4e02-b5a2-fe8b4d873612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61776) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 13:42:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.wsgi [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] HTTP exception thrown: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Request method failure captured: Apr 14 13:42:05 user devstack@n-api.service[61776]: request: GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 HTTP/1.1 Apr 14 13:42:05 user devstack@n-api.service[61776]: Accept: application/json Apr 14 13:42:05 user devstack@n-api.service[61776]: Accept-Encoding: identity Apr 14 13:42:05 user devstack@n-api.service[61776]: Connection: close Apr 14 13:42:05 user devstack@n-api.service[61776]: Content-Length: 0 Apr 14 13:42:05 user devstack@n-api.service[61776]: Content-Type: application/json Apr 14 13:42:05 user devstack@n-api.service[61776]: Host: 10.0.0.210 Apr 14 13:42:05 user devstack@n-api.service[61776]: Openstack-System-Scope: None Apr 14 13:42:05 user devstack@n-api.service[61776]: User-Agent: python-urllib3/1.26.15 Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Auth-Token: gAAAAABkOVJdPWOaEMBBRkM9bnjCFOi8QwF62Mb_PL3OOw7TrBnUCy5axahs9f7PZHK3WgMOhZrqOiAzn5zn78TBowFd1va3VmKcA-Tyu4D0fVbz4IyNsKVRi32duDcC9vI85DOrqxDAHg-EdAOh8PgKMoTpVcU_0B1DtaSX9oBDoLzZsxVMufI Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Domain-Id: None Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Domain-Name: None Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Identity-Status: Confirmed Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Is-Admin-Project: True Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Project-Domain-Id: default Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Project-Domain-Name: Default Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Project-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Project-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Role: reader,member Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Roles: reader,member Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b197f1df57f4dee9757639cf861eb97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Tenant: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Tenant-Id: 4b197f1df57f4dee9757639cf861eb97 Apr 14 13:42:05 user devstack@n-api.service[61776]: X-Tenant-Name: tempest-ServerActionsTestJSON-1929049437 Apr 14 13:42:05 user devstack@n-api.service[61776]: X-User: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:42:05 user devstack@n-api.service[61776]: X-User-Domain-Id: default Apr 14 13:42:05 user devstack@n-api.service[61776]: X-User-Domain-Name: Default Apr 14 13:42:05 user devstack@n-api.service[61776]: X-User-Id: 9169729edbd04fd5a74d2cffd0aa437f Apr 14 13:42:05 user devstack@n-api.service[61776]: X-User-Name: tempest-ServerActionsTestJSON-1929049437-project-member Apr 14 13:42:05 user devstack@n-api.service[61776]: method: > Apr 14 13:42:05 user devstack@n-api.service[61776]: exception: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61776]: action_args: {'id': '6e646c88-579e-4ea1-b987-da1c7194a064'} Apr 14 13:42:05 user devstack@n-api.service[61776]: {{(pid=61776) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. Apr 14 13:42:05 user devstack@n-api.service[61776]: ERROR nova.api.openstack.wsgi Apr 14 13:42:05 user devstack@n-api.service[61776]: DEBUG nova.api.openstack.wsgi [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Returning 404 to user: Instance 6e646c88-579e-4ea1-b987-da1c7194a064 could not be found. {{(pid=61776) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 13:42:05 user devstack@n-api.service[61776]: INFO nova.api.openstack.requestlog [None req-3907bf37-83f9-4e77-bbbb-51fa5ba5b20a tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064" status: 404 len: 111 microversion: 2.1 time: 0.038287 Apr 14 13:42:05 user devstack@n-api.service[61776]: [pid: 61776|app: 0|req: 389/1155] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 13:42:05 2023] GET /compute/v2.1/servers/6e646c88-579e-4ea1-b987-da1c7194a064 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 13:42:05 user devstack@n-api.service[61774]: DEBUG nova.api.openstack.wsgi [None req-61dafba2-d291-4ce1-96b9-5956705a3967 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] Calling method '.version_select at 0x7fa743832050>' {{(pid=61774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 13:42:05 user devstack@n-api.service[61774]: INFO nova.api.openstack.requestlog [None req-61dafba2-d291-4ce1-96b9-5956705a3967 tempest-ServerActionsTestJSON-1929049437 tempest-ServerActionsTestJSON-1929049437-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-267883713" status: 202 len: 0 microversion: 2.1 time: 0.026564 Apr 14 13:42:05 user devstack@n-api.service[61774]: [pid: 61774|app: 0|req: 385/1156] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 13:42:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-267883713 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)